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.V PREFACE - . 

This is the final report of a project that had its origins in a small 
• field study of Man; A Course of Study (MACOS) copducted by Cort, et ah , 
in 1970. * It was a conclusion of that study that it was difficuJt to anticipate 
from the formati5^e evaluation conducted by the developers of MACOS how 
the Curriculum would worTconce it became generally availaWeto a wide variety 
of schools, teachers and students. It was the belief of manj^ of the teachers 
interviewed* that they could teach the same skills, and" encourage development 
of the same attitudes, by other means. Yet many teachers felt that the ^ 
curriculum facilitated a studlent-c entered gtyle of teaching, and that it 
stimtdated interest in students which in turn enhanced the opportunity for- o» 
them to develop a variety of skills and understandings. It was also the con- 
elusion of that study that further evaluation of MACOS should be comparative, ^ 
and it should be longitudinal, that is, it should systematically attempt to 
compare MACOS' with other programs, and it should jiot stop with the end of „ _ 
ihe course. - ^ . ' 

.The present study has followed those guidelines. It may be argued 
that each social studies curriculum is unique. Each program has its specific 
goals and particular content. Therefore, to compare programs i^ to compare 
apples and oranges. The argument is true in specifics; it is unconvincing at 

•* Cort„ H. R. , Henderson, N. H. , and Jones, G. Approaches to 

further study of Man: A Course of Study. Final Report . Washington, D. C. : 
The Washington School of Psychiatry, I^ebruary 19, 1971. 



a higher^l^el, of generality** At some level, and at some pointy most social 



studies programs apipear to have similar aims' wlflrre5pect"toH:he-mental^nd__^ 

social development of students. In English, a course in Shakespeare has 

different learning outcomes from a course in MoliSre. Yet one may hazard \ 

.' ' , ' > 

the guess that both courses would have certain common underlying goals: to 

be able to discern the structure and^techniques used by the playwright; to be 

able tp see the relationships between the characters and situations of the play 

and one's own world; to be able to read^ other plays with deeper understanding, 

criticalness, and appreciation, to suggest but a few. It is in this sense that 



most social studies programs seem to have points in common. Certainly there 

is th& issue of course content , and it,of course, in social studies is also related 

— ■ ** , < * 

to oj^rerarching goals. It-is^ important to gain knowledge* Much debate about ' 
content in the social studies appear? to center % questions of what knowledge, 
when taught^. how taught, toward What ends or goals.^ ^ ' 

The present study was most certainly not intended to try to answer 
such questions. lirwas intended-tt?^,be"descriptivei-but descriptive in a context. / 
The context is social studies in general, Thus-^ the'^study has sought to describe 
MACOS as it was implemented under natural conditions by a variety of teacliers 
in a variety pf settings^^ It has oSso sought to describe characteristics oi MACOS 
in relation, not to particular alternative programs, but in relation to other 
programs generally. Jt ijI^aUejinptfed,- witKi ti the limits of resources and, " \ 
method, to depict similarities and differences of a limited range of course out- 
comes for students (knowledge,* skills, attitudes, behavior), and characteristics 



of teachers and classes, Mrithihose of an aggregate of other courses or programs. 



The alternative courses or programs came from the, same school districts as the 
* ■ - * 

MACOS classes. Thus, wejiave viev/ed them, in the aggregate, as providing a 

background or form of baseline for the MACOS classes, also considered in the 

-» " . , * • 

aggregate. 

- The study has attempted to explore a number*of questions and issues of 
.cpncern to a variety of audiences. It leaves many questions unanswered. Some - 
questions receive only partial answers. Some questions are not answerable.ab - 
all, at least within the limits of time and .method of this study. The data collected 

can be used to explore protest hypotheses that time did not permit in this study. 

yr"^' ^ / ■ . . ^ . : . 

ItJs hjoped that others will want to.re-analyze^ or analyze further,some of the 



data obtained by this'^^Study. 

_ " As noted, the ^-study wa^s intended to be descriptive, not judgmental, " 
although inevitably values are involved in determining what and how to observe • 
and describe^. It undertook to examine MACOS and other qourses as they were 
likely io be implemented, not as they could be implemented under special 

\ ' • ^ ' ^ ; 

condition^\of training/' supervision, support anS the like. Suggestions of what 
should be taught ofrhow it shoyld be taught wer6 carefully avoided. 

* * , . The difficult problem of attempting to determine what was taught, and 
how, was approached in three w^yst by tape recording classes to provide - 
transcripts for subseb[uent analysis; by means of checklists and rating scales 
completed by students and thei^ teachers; and by maans of repeated interviews 
with (teachers and sn^^ll groups of students from each class during the year. * 



' • . . 



would have come from continuous, SiP^ pbservatiotu Collectiveiy;they did 
yield substantial information about whatihe classes in the study/did and what 

they were like. * * . / 

9 ^ J ^ ' - ^ " .-^ 

'The study employed pre and post tests that were intended to provide 
meai^ures of selected knowledge, skills and attitudes. One instrument was based , 
specifically on MACOS course content. Otherwise, ihe instruments were intended 
to.measure skills and attitudes that seemed related to goals of MACOS and many 
other social studies programs. Paper and pencil tests and interviews both harve 
limitations as observational and measurement procedures.'-especially with 
respect to som« of the more complex 'processes that seem to.b,e the-gpafls of many , 
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^Jfcial studies programsV Thus, views of processes and outcomes in the MACCfe- 

and other courses in this study have to be regarded as constrained by tho»e two 

—main filters. * • , * ^ , 

The project reported here is the result of the efforts, Interest and 

cooperation of mansr people: teachers, students^ princij)als, administratorsV^^ . 

..staff, consultants and others. The project woild like to express appreciation 

to all who.participated. Districts, schools, teachers and students were assured 

- ■ - ^ 

anonymity and thus cannot be listed to receive the recognition to wlych they are 

• so thoroughly entitled. It is hoped that they will find, especially in the summary 

of the Study, that their time, and effort has-been to good avail. 

It is appropriate also to acknowledge the role of the National Science, 

Foundation. It was of course the granting agency. The NSF at no time attempted- 

- ■ . « * 

9 . " - 

" • ■ '■■ . 6 ' , ■ - ■ . 

<* > IV - i> •* 



to itrfluence what \vas doni'ohce^e study was started. It lias not attempted in 
any way'to influence findings, interpr^ations, 'or conclusions. It has encouraged 
the project to mak§ its"'ftiidiugs, both positive and.aegatlve with respect to MACOS, 
as readable and widely acces^le as possible* Shortcomingis in those regards 
ire the responsibility of the Vo3^t» Hot the fault of the NSF.. , 

The study has been independent* It has of course been shaped by many 
considerations, methodologically as well as substantrvely. It has tried to main-^ 
talh a perspective of issues, characteristics and concern? of the br^ad field of. 
the social studies, and to exanaine M^ACOS in that perspective as well as to 
inquii:e,abcxut jts unique properties* • ] 



"On pap;e 14 of the Swmninry Report {niul the Siimfiliiry .section of Voliunc I of 
tlfc-f\in report), -the Hrst sentence imdor the headijii;,. Attitudes Tounrds 
Problem-^SolvipK /?houUl reruVas forh5\vV^ . * - 

On thc^CAi^S tosts at }TOsttest/tho*MAC<)S c4aKSOii skqvc not KiKnjfienntly 
diTferent frofn non-MACOS'chisse^; on the nver:i^a\ inlerdst'in prdbleni- 
s'ojviug, tolerance. of nmbij^uity in'pi^oblejns, aird percei vedjibUity toihink 
ccentivejy. . • ^ ' . [ . /. 
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You indicated in one of your questionnaires that 

{/ ) is considered an important thrust or focus 

of your social studies program this year, A^Tiat will 
you look for specifically as evidence of success in 
this area? ^ ; • 

What are the strategies, methods and activities youhav^ 
employed so far that are intended to develop the knoMjl^ge 
skills and/or attitudes of this focus or thrust? 

Could you tell me what you specifically expept^your 
students- to know or to be able to do as a ^ninimum at 
the end,of the^ yeai?? 

A. What do you find to be the most difficult problem 

you have to deal within teaching social^^studies^to stuclents 
at this grade-level? -y' ^ -.^ 

B. If you had the power to affect any necessary change in 
order to resolve theproblem(s), what would you do? 

Does your social studies program differ in any important 
way from your program latstyear? (If yes, ifi what way 
or ways?) ' * 
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reports, etc. ?) TOch of these things do ym/like best? 
Wh^ do you like them?) / . 

Why do you study social studies in school? (If no answer , * 
do you think what you learn might be important to you 
sometime?) (If no, UTiy not?) If Yes, How do you think social 
studied might be important to you? (If to learn about 
history, or pedple, etc. , how do ybu think that may be 
important to you?) 

A, ' Are there any similarities between the social studies 
program this year and the social studies progfam in the 
two previous years? \\Tiat are these similarities?^^ 
B» Are there any differences between the social studies 
program^ this year and the social studies program in the 
previous^ two years? What are these differences? . ^ 
C* Are there any similarities between the students^ social 
studies program this year and their program next year? " ^ 
Are there any differences betweeh the students* Isocial 
studies program this year and their program next year? 

From what you can tell, has the social studies program 
had any influence or effect on the lives or -activities- of 
your students' outside sqjiool? {If yes, please describe.) 

From what you can tell has^ there be^n any Reaction or 
comments about your social stu^lies program from members 
of the community or parents? 

Have you dealt with any significant local or national contro- . 
versial issues in.your social studies program this year? If 
Yes: 1. Would you please list them? 2. How did you handle 
them in class? What activities were used? 
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Havfe you dealt with anj' controversial concepts or subjects in 
your social studies program this year? If Yes: 1. Would you 
please list them? 2. How did you handle theni in class? ' 
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Were there any controversial concepts or subjects you 
could have dealt with in your program or materials^ wh>ch 
you decided not to go into in class? - . ~ ^ 

\^Tiat positive or negative effects has our research project 
had on you, your students or the schpol this year? 
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year? li no: What do you think we missed?- " , 
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Last^year in social studies, did you ever study or discuss a^y^ 
thing that the kids got really excited or upset about? ^^Tiat 
were those things? ^\Tiat'happened? Did it chapge-kids 'minds 
about anything, for example? ^ 
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SUMMARY" 

^ s 



/ ■ ■ 

The following pages contain a summary of the project. They also ^ 
contain inferpretations, where they appeared to be useful, and conclusions. . ' , 

•This mammary is intended to serve two purposes." If is included at 
the beginning of the full, final report of the study to pro\;ide th j reader with an 
oveirview of what to.us appear to ,be the main findings of the study. The summary 
is alsa intended for separate distribution to a wide variety of audiences that inay 
have neither the time nor the inclination to go through the full report. It is thus " ' 
w^ritten p^ncipally with^uch audiences in mind. Technical details have been 
avoided, although we have tried to make clear the bases and limitations of con- 
'eluding statements. Because the summary serves a 'dual purpose, it contains 
some background description material that is also contained, although«in more 

detail, in the full report. ' . ^ 

The summary starts with a brief description df the project. The next 
section presents major outcomes or findings,, particularly with respect to 
achievement- and attitudes of students. Following that-is a section dealing with 
characteristics of the two groups of classes in the study: the MACOS! group, and 
the comparis9n non-MACOS group.. This section inqludes a report on interrelation 
shFps among major groups of variables that we^e examined in the study.^ That is 
• followed by a section on the MACOS and non-MACOS teachers. Finaily, there'are 
concruding remarks. ^ ^ . , 



• ^ BRIEF DESCRIPTION OF THE STUi^Y 

. This if a summary of a two-yeat study of Man: A Course of Study 
(lilACOS), as it was taught in 57 fifth grade, sixth grade, and 5/6 non-graded 
classes during the 1974-75 school year. The classes were in 15 school districts 
M 11 states. * There were 51 comparison, classes ia the same districts afc the 

same'grade levels. Most district;s were suburban; some were urban and rural. 

• * • • ' 

The districts and classes in the study were not random samples. They 

were districts and classes that met certain criteria for inclusion in the 'study, 

and "that agreed to participate. ' The districts were originally recruited by means 

of a questionnaire sent to alL public schodl districts. An aim of the study was l:o 

have only one class (MACOS or non-MACOS)^ per school within ^district. That^ 

aim was not always met. With two excej)tions.t however, MACOS and non-MACOS 

classes did not come from the same schools. ' , ^ ' 

ft 

- The aims of the study, bk^oadly stated, wer^ to examine what MACOS 

students seem to learn, what they retain, -and how what was learned was different 
from what they might have learned otherwise. MACOS is one of.the -more elaborate 
developments of the ''new social studies" projects of the 1960:s. It was originally 
designed, as a one-year course for upper elementary children. It appeared to 

combine the content and methods of behavioral. science with a humanistic 

■ ~, ' o 

orientation towards education. It was an attempt to embody in a curriculum the . 

concept of the structure of a discipline. That is, it was based on the premises 



* Califprniai Colorado, Florida, Illinois, Iowa, Nebraska, New Jersey. 
"PenfisylVaHia,' Oregon, Virginia, W^sringtori. ' • ^ . ' 



that: 1) disciplines have an underlying structure (set of principles, relationships, 

assumoHons, etc.); 2) the structure serves to organize the myriad of available 

facts and information, and to stimulate'further inquiry; 3) the structure can be 

grasped in some form by students of almost any age; and 4) grasptag the organizing. 

• ' ' - * ' 

Structure is an aid to effective learning and a motivating force forjurther 

learning. The curriculum was thus built on the "spiral design" in which certain 

concepts and principles are introduced in simple form, and elaborated in grfedlfer . 

^jvtcomplestity and scope as further principles and conditions are introduced. 

The goals, of MACOS are^iroad and not easily translated into specific • 
operational terms> The. curriculum-^ittempts to emfiody certain principles of 
learning formulated by Bruner. It provides the opportunity for information to be 
obtainjed in many ways, e»g». from written materials, film^, records, games, 
discussions . It seeks to encourage students to learn together, and to inter^t^ 
with each other, as a motivating device. It encourages teachers to take a 
problem-solving role rather than a lecture or questlon-answer-questlon 

' approach to teaching. It encourages multiple approaches to the presentation 
of topics, and thus tries to inflCience teachers to adapt to the various interests 
and abilities of their^students. It seeks to command interest in students by 
authenticity or realism; it is as concerned wfth howthitngs areleai*ned as with, 
what is learned (process is as important as product). It has a hierarchy of 
concepts, but it is not designed on a behavioral objectives model, or on a 
hi e/archy of behavioral objectives.^ 

MAGOS thus was an ambitious and interesting curriculum, from a number 
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of points of view... It has stimulated controversies almost from its Inceptioo.' 
ft was pilot-tested extensively, and an.ebborate formative evaluations was * 
conducted^ Questions remained,^ however, about what would happen when' the 
durriculum became generally available. As one alternative^program among . . 
, Which* schools' can choose, how does it seem to work? What is different about 
■ MACbs from other progi*ams? What is similar? Is thfere evidence that it 
"achieves ifs goals? ' If so, with whom? Under what conditions? What is the 
consequence to students of'taking MACOS for a year? What, in fSct, is a 
MACOS program? ♦ 

* • • 

• These ifuestioAs are broad. The present study was intended to examine 
MACOS classes as taught by a variety of teachersMn a variety of settings. It ^ 
has undertaken to examine the effectiveness of MACOS with respect to achieve- 
m^nt and motivatioi\. It has soug^it to explore what teachers and students see 
themselves as doing in MA€OS,^£.nd why. The basic method has been comparative. 
The study has been primarily descriptive. It has attempted to delineate a number 
of similarities and differences of MACOS, compared to a variety of programs 
that students might otherwise have had. It has essentially asked: if one 

* * * 

implements MACQS, what are .some of the results in classroom processes 
and student learning that one can expect, -and how, on the average, are .they 
similar to and different from those of an aggregate of other programs? 

^ It was not the purpose of the study to compare MACOS to other particular 
curricula, nor were other particular programs sought as comparison clas5^es. 
Thus, the group of classes called non-MACOS was a collection .of a number of k 



dlffe^pnt programs. The tion-MACOS classes differed among pach other, >nd 
from MACOS classes, with respect to specific content. There were many 

* " " ' • ■ . ^ 

commonaUtles, however, witliin and between the groups of classes with respect 

. . . / . . • " , _ »- 

.- / t . , ■ 

to broad objectives, methocis, problems tind contexts. Indeed, except for 
specific content and specific content-related objectives, there were no variables 
or characteristics examined In this study that were unique to all the MACOS ' 
classes Or to all the non-MACOS classes. TOle-there were significant „ 
differences between the MACOS and non-MACOS groups of classes for.some 
'^classroom process (what was done), climate (what students thought of.classes), 
posttest apd foljow-up variables, there was no variable on which all MACCB 
clashes were better or worse, higher or\ower, more or less, than all non- 
MACOS classes. ' , 

Sinpe an aim of the study was to^ex'amlne MACOS and non-MACOS 
classes. as *:hey» were likely to be taught under natural conditions, no require- 
ments were set for what i^hould be taught, or how. Indeed, every effort was 
-made to avoid suggesting what te"achers should do or cover. 
Methods ' " ' * • ' 

, * MACOS and non-MACOS classes^wsere given pretests nnd posttests 
intended to measure aelected specific and general achievement and attitude 
variables. Pretext instruments were also administered to teachers. * 



* Two of these were Kerllnger and Pedhazur's Educational Scale VII, and 
Pedhazur 's TeaQhers'^at Work scale- ^Both were intended to provide 
measur.es of progressive and traditional attitudes toward educational 
practices and goals. - ' . <. 



■ i<andom*aamples of students from each-class were Iftterviewed at three dlf- 

• ferent times during the year; teachers were also Interviewed at thtfse times: 

A tape recording was made of each clhSSiand the transcripts of a random sample 

4 

of Classes from each group .were analyzed using the Aschner-Gallagher system 
fdr analyzing convergent, divergent, and evaluative thinking questions. 

Shortly after midyear, classes completed a series of rating scal<;s, 
If&apted from Joe M. Steele's Clagsroom Activities Questionnaire. The scales 
were Intended to provide measures of classroom activities and emphases 
(processes) as perceived by students. There were also scales of classroom . 
climate (satisfaction, apathy,'^fflculty), again as perceived by students. The 
. ijl'l ^a' 3 scales were from Walberg's My Class, and 'And.erson's Learhlng ^ 

i ' Ku>firooment inventory . At the same time, teachers completed ratings of the 

■'>' • . " • ■ • ' 

frequency of activities, and of curriculum emphases In their classes. Difitrict 

- coordinators provided Information about the schools involved In the study,, 
about the districts, about procedures and policies for selecting social 
studies and other cttrricula, and about the ways in which MACOS and qlher 
social studies curricula had affected the school syst.em. The following year, 
tKey also provided some information about costs. , ' 

During the next school year (1975-76), two follow-ups were made with 
a 50% sample of students from each previous class. Follow-up sampling was 
limited to students who had been In tft^previous MACOS or non-MACpSjJlass 
for the entire year. The first follow-up ^as made In Oetober, and the second 

• one In' May, a -year after MACOS. Paper and pencil Instruments were 
administered each time. In addition, a group discission was held with ea^ . 

« . class in the first Joll6w-up. In the final follow-up, sohje instruments that 



had been given pre and post the precedin^j^ar were readminisCfered* 
The pre - post Instruments were: ' - 

Achipvement ' . . ^ 

. A'lQuegtionnaire^About Animals and People (AP), which 
L contained questlona from (or modified from)* the MACCfe 

formative evaluation, and the MACOS Evaluation Strategies 
ho6klet* Part of t^ test was'lncludfed in thp second ,lollow-up* 

\ ' ' ' y \ ' ' 

Sequential Tests of Educational P^pgr^ss (STEP), Social- 

• , * ' ^ . < . 

J^udles, (Series n, Form 4A), a standardized test of social 
studies skills and knowledge. ^ ' 
Interpretation of Data Test qPT), a test, develotfed for the 
Taba program, of ability to Interpret and use ethnographic 

data. . . " 

/ ' ' ^ 

Attitudes;^"'-: - ' \ 

Stud£^feoices (SSCh)i ^pair-comparison instrument in which 
preference for social studies was indicated individually in . - 
^ relation to math, science, English, spelling and "reading 
' (scored here by Counting the number of times social studies 
was cijosen). A modified version was included in the s'econd 
follow-up.* ' ' * . , 

What Would You Think . Part A- and B, (WWA, WWB). which 

|f i « ■ 

' -asked students to indicate their reactions t^Tunusual, 

' ' . ' ■ -." . 

hypothcti^frl belififs!, customs or behavior (Part A), and 
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toward persohs or groups that would have such beliefs, 
customs or Kehavior (Part B)» This instrument was repeated 
in the secbnd follow-up, along with two additional ifems of a 
similar kind. , * ^ ' ^ , 



^ Children's Attitude Toward Problem-SolvtDg Inventory (CAPS), 
fleveloped by Martin Covington at Berkeley, and scored here 
for four separate scales derived from abactor analysist . , 

interest in j^robl em-solving; ability to solve problem??; ^ 

r ' ' * * 

'tolerance of ambiguity in problems; iind creativity in thinking 
or problem-solving. " \ " 

Major analyses of results were of two kinds^ boihparisohs of 
differences between MACOS\pnd non-MACOS classes as groups, -and examina- 
Hons of relationships among yarlableS. In bo-xh c^ses, thfe unit* of analysis was 
the cjlass, l.e; , the individual measures were class means,^ Class meana were 
abased on scores from students who had been in a class all year. Some item 



""analyses, and analyses of certain opinions, were also done using the individual 

• . * \ ' ' J r ^ ' 

Student as"the unit of aAelysls. The distinction is important, sincejresult^ 
based on class means do not necessarily apply to individuals, and^results ^ 
based on^Jj^viduals do- not niicessarily apply to classes. & * , 




MAJOR OUTCOMES 

• Variatioa in Implementation ^ 

One of the ihost striking featifres of the MACSDS classes in this «tudy 
'^C] was the variation la Implemeatatlon. The total^ amount of time apent on social 
studies as -a whole was- similar la both^MACOS and noa-MACOS groups. The 
average was about hours per week for 27 to 30 weeks. The percentage of 

» ^ MACOS' lesions actually taught by the time of posttesllng, howeyer, ranged- 

- * . 'l • ^ ^ " , . . ' -^^^ ^ ' 

, from 16. to 100%. The typical pattern was to supplement MACOS with other 

^ • lessoiis or programs* Wlille teachers did not reverse the order* of lessons, 

\ o * . ' 

they would often omit one or more lessons. Some teachers said they found 
♦that ikACOS seemed particularly suited for branching into other "units or lessons. 
Vrhey felt that such 'flexibility was a strong poJnt. There were classes in th.e 
■ study that were straight MACOS classes. • But if the MACOS classes in this 
study are at all Indicative of how the curriculum Is Implemented In general, 



one would have to conclude that diversity.of adaptation is the prevailing mod'e. 
Achievement Outcomes' ' . ^ ^ " * - 

besp'lte this diversify of implementation, MACOS classes did learn similar ^ v » 
content. mACDS classes scored significantly hijgher than non-MACOS 
classes, on the average, on the MACOS-^peclflc test given Bt posttest, and , 
on a sub-part- of it given again a year after the course. * Periodic Interviews 
with stud ents confirm edrthe development of detailed course knowledge, just as 



^ Throughout this report, the . 05 level of chance is used as the criterion of 
significance of a , difference or a relationship,^ 
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they did with students in.non-MACOS courses.* .^udentS obviously did tend to 
learo what they studied rather than something else. Howev.er, an adalysis of • 

* * ✓ 

items da the MACOS posttest suggested that, at least as measured J)/the test, 

the leaniing was most effective with facts and termp; and least effective with - 

- - - - - — , 1 9 , 

some of the njore abstrac^.concepts of the cpurse such as structure, function, 

and language. posttest,, sixty-two percent.of MACC6 and ooa,-MAC!OS ' • 

students alike classified '♦human being" ajf^the opposite of animal, '^when the 

choice considered correct was ^^a mammal an^ a primatCj." Since p^*rformance 

on the part of the test covering such abstract concepts was significantly 

related to. the age of students (sixth grade MACOS classes tended to dp bettief ^ 

than fifth grade classes), it seems reasonablfe to conclude that'the course was ^ 

generally more appropriate for older students insofdi' as mastering' the more • 

abstract concepts and relationships is concerned. - ^ . ^ . ' 

r } • . . 

On more .generalized test^ of social studies skills (i. e. , on tests that 

were not curriculum-specific), taTcihg^MACOS neither helped nor hindered 

classes, on the average. For example, there were no significant differenq^es 

at pretest or at postjest between the MACOS and non-MAGOS groups of classes 

on the STEP Social Studies test (Series II, Form 4A). the same was true of 

performance on the Interpretation of Data test (IDT)..- In an experiment conducted 

by the Antioch study shortly after midyear, groups of four students from each 

* All interviews with students; except ih the first fo!lov>-ul), were conducted ' 
with a random sample of^four students frofn a class.J The students were 
interview^ed as a group. Interviews were taped, and ttartecnpts were coded 
'by three readers wbrkiag independently. If at least one student jin the group 
mentioned a topic or g reactionrth'at'responise wa?5 counted as pertaining to 
the whole class. Tihus,^ interview jft&sults are t)rpicallystated in te'cms of ^ 
classes^. ^ * • - _ 

\ ^ IdtO ♦ « $ • 



class, .chosen at i^andbm, were ask*HJ to compare two scenes, one historical 
'(early America) and on,e modern, and to speculate on similarities and diff^ences 
of tfie problems faced by the.two groups of people. We found no differences 
b^een MACOS and non-MACOS groups in quality or quantity of hypotheses 
' proposed,' on the average, nor in a tendency to test or explore proposed 
hypotheses. The latter was regarded as an Indication of constructive, 
pKobl em-solving interaction among students, 'There wa|^ great va:^^ 
, sophistication and productivity* among the samples of students l^oth in the MACOS 
and a6n-MAC0S groups. Other interview material, during ther course and 
in follow-up, gave no suggestion that there were differences between MACOS 
' and iion-MACOS groups in thei? understanding or use of inquiry skills, although 
again there was much variation within both groups. 

Development of Inquiry skills was said to be a part of the social studies 

- ' - ' ■ \ 

program by nearly all teachers. Such skills, when described^ by teachers in 
interviews, included questioning or analyzing what was seen, read or heyd, 
forir^ing hypotheses, gathering information, evaluating information, drawing 
conclusions, making generalizations. Teachers described different ii/ethods 
. of developing such skilii. In^nterviews, students rarely used, spon^neously 



a vocabulary suggestive, of th'^ elements of anjnquiry niethodologsr/ Students^ 

' in different classes, described how they would compare things: ho^ they would 

/ 

discuss questions over which there was disagreement; how the/ would go back 

— — , — _ — ^^^^ — — _ ^ ,^ ^ — . ^ 

to references (books, ftlms, etc. ) to resolve, disagreements^^ which were 
, typicalfy over thje correctness of asserted f^)cts.,^r On ques(tibns jof opinion or 
belief, students described having a discussioti to hear d if f>rent, points of view. 



or taking a poll (during the class). "^T'eachers typically said they guid.ed such 
• discuSBions, trying to* make sure that different points of view were heard 
- (depending on the subject, the class, and the teacher), and would sometimes 

^ * • 

assign students to Ipok up, and to report on, a topic or subject o\^er which 
there was disagreement or uncertainty. . . . 

The data of this study do not provide systematic information about the 

• development of inquiry skills, or of organizing models or techniques. Such 
data as the study obtained, from paper and pencil instiniments, interviews, and 
a" special problem-identifying experiment undertaken with students during an 
Interview period, suggest that: .1) such developments are' not usually articulated 
• - by*students; 2) there is great variability of development frbm class to class 

' and within classes; 3) there is need for much more subtle and "extensive- 
inethods of observafionTnd assessment, thgn this study was able to pmploy in , 
order to assess such develcpmer\ts reliably in the social studies. Perhaps the - 
development of inquiry skills and conceptual models in young children is 
similar to'the development of language. They develop: then later one learns 
to name, describe and - analyze the elements, rules and principles for what one 
, - has been doing all along, as well as to improve upon the process. It did seem, . 

' however, that an attempt to provide students with a vocabulary and ^atements 
of objectives for classifying and analyzing situations and problems, as well 
much guided practice, would be helpful. If the former were done systematically 
in the classes "in this study, we failed to detect it.. 

Analysis of tallieg of data from interviews with teachers and students . 

■ . ■ ■ n " ' • . . 
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Indicated that non-MACX)S students were much more likely than MACOS dtudents to be 
exposed to training in specific skills (how to make maps, how to^read them). Some 
'MAC06 teachers ^/however,, incorporated special units on such skills. Students 
in different classes reported learning various how-to-do-it skills ~ e.g. , how 
to make an igloo, how to inake a pinata. Noii-MACXDS classes, more, than MACOS* 
classes^ were likely to describe writing reports as a recurring activity. Thus, 
non-MACQS students, on the wjiole, had more opportunity to practice skills 
involved in that task. , * 

« , Teachers in both groups of classes (M^COS, non-MACOS) sometimes 
had particular problems teaching, students how to work cooperatively in small 
groups on a task or assignment- Some teachers gave up and reorganized the 
management of instruction: Others invested unanticipated amounts »of time and 
effort to help students learn to work cooperatively and constructively together. 
It is impossi^Je to say from the data of this study what the success of such \ 
training was, or to what extent whatever learning took place transferred to 



) what extent what 
Other situations. • 



I 



In sum, students did terfti^to learn much about the content of whatever ^ 
they were studying. The details described by them in interviews tended to be^ 

^ about fact^. Students would u^e the vocabularies of their particular courses 

i ^ . - " ^ 

with varying degrees of accuracy and appropriateness. They would describe 

1 • *i 

what animals or people did? they Would describe customs: they would often 

, f * * 

give reasons for how, or for why, things were done as they were in different 

countries or cultures: they would make comparisons; they wuld make judgments. 



Within aay clas. , of course, there was a range of mastery and comprehension, 

ev*en of factual materiaj, ^ - 

Attitudes Toward Problem-Solving * 

Oh the CAPS tests at posttest, the MACOS classes were significantly 
" > • ' i ' * * - . ' ^ 

different from non-MACOS classes, ?Qn the average, in interest in problem- 

solving, tolerance of ambiguity in problems, and perceived ability to think 

creatively. Non-MACOSclasses tended to score more positively, on the average^ 

tjian MACds classes on perceived ability to solve problems. There was indica^ 

tion in the. MAC OS group that more int^resf tn' problem-solving tendecl to go 

along with more complete implementation of the MACOS curriculurii. ^COS 

classes may have stimulated more positive perceptions or attitudes about pro- 

\- • . * - • " 

blem-solving in individuals, but comparisons of class averages between groups 

> . ' ' . 

did not suggest a systematic effect for three of four of the measures used. It 
is concluded that the MACOS classes in general did not stimulate confidence 
in the powers pf one's mind significantly more than the aggregate of non-MACOS. 
classes. Indeed, the MACOS claaaes tended to have comparatively less posi- 
tive perceptions o£ aj)ility to solve problems. A 
Attitudes Towards Different People and Customs . 

On the instrument ( What Would You Think) intended to measure students 
attitudes towards or reactions to unusual, hypothetical customs, beliefs andl^e- 

havior, as well as to peoples or groups that might have them, there was tentative 

*^ , » * " ^ * 

Vindication that MACOS classes on the average reacted more positively 



*The computed reliabilities of the CAPS sub-tests- for .class means (but rxo^for 
individu'^ls) were extremely low.. It is possible that re-anaysis, based on types 
of individuals, would yield different conclusions. ^ » ' ' 
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to the customs or beliefs at posttest than the non-MACOS classes. There was, 
however, no significant difference between the two groups of classeis on that 
measure a year after the course. With respect to reaclit)ns to groups, of 
people who might haye. such customs of belief^, differences between MACOS and 
noa-MACOS classes fell short of significance at posttest. There was marginal 
indication that MACOS classes tended to readt more positively toward people v\4io 
might have such customs than non-MACOS classes, on the average, a year 
later (the data were from. a random 50% sample of students from each former- 
class). These results are called tentative or marginal for several reasons, one 

being that the computed'reliability of the instrument was very low, even for 

,r /_ / . . . ' " . - 

^ class means. We interpret the results to suggest that there can be influences 
of MACOS on reactions of classes to strange or unusual customs or beliefs/ The 

influences may "be small and transient: they are nonetheless suggestive in that 

t • ' ' ' ' . 

they at least seem consistent with MACGS goals. More extensive and reliable 
measurement woulcj provide clarification, / 

In interviews with students we found no systematic indication of 
differences between MACOS and non-MAC^^roups of classes in general 
attitudes toward the cultures or countries they had studied. Students, if they 
were not bored with the whole matter, tended to see both positive and negative 
points 3bf>ut whomever or whatever they studied. Students in both groups were 
most Ukely to feel,iiegatively about customs or practices they, saw as unfair, 
"cruel or exploitative. MACOS students, aside from being appalled at. (or 
intrigued by) the Netsiliks^' eating preferences and habits, w^re apt to be 
/r — 

V 



dismayed at their treatment.of animals, at, the manner in which they killed 
animals, at their ^:reatment of the elderly. Aspects of the Netsilik culture that 

* . ' " -• ^ — e 

studeMs admired were their conservation practices (making naaximum use of 
available resources and not wajsting anything, not polluting the environment), 
and the atmosphere of closeness and carinj^ created in familfes. ( a number of 
students also envied the Net&ilik children not having to go to school), Non- 
MACOS students were similarly negative about practices they had learned 
about that seemed Unfair, cruel or exploitative (human^sacriflces, pre-arranged 

' marriages, slavery, treatment of Indians by early Americans, poverty — to 
name a few topics given by student:^). We found no students giving any indication 
thalf they would want. to trade places with the Netsilik: no one appeared to have 
developed a desire to eat fish eyes. Two MACOS students, out of oyer two 
hundred interviewed, mentioned that the act of abandoning the old' woman on the 
ice was desirable in the sense of being necessary for group survival. Most 
students who mentioned that event af^ll thought some other solution shpuld have 
been found. Most students vho mentioned I^^etsilik customs such as putting ashes 

' on fishes* eyes seemed to regard them as interesting customs, but In fhe nature 
of superstitions. M^.riy students in both groups, MACOS and non-MACOS, when 

^'mentioning a custom that was d if ferent*^ from ours, but not seemingly cruel or- 
unfair, would add statements to the elffect that "they have their ways, we have 

ours." \ 

Itt sum, nearly all classes in both groups, when interviewed at post- 



jtest, felt they had learned about customs, beliefs or the way people lived that 

• - » ' • ■ 

seemed strange. The majority of classes in both groups felt they had learned' 
about customs or ways "of life they thought were wrong. Finally, the majority 

I 

of MACXDS and non-MACOS classes cited examples of customs,, beliefs or ways - 
people live about which they had learned that seemed commendable; 
Attitudes Towara-Vivid Topics in Retrospect 

In an attenapt to assess continuing opinions of or attitudes toward ^ 
potentially vivid or controversial topi(Js students may have studied, students 
w.ere asked on questionnaires twice during the year following MACOS if certain 
• topics had bothered or upset them. In the final follow-up at the end of the year, 
' the two topics that a small fraction (at most, 11%) of MACOS studentis (not ^ 
clajsses) continued to Indicate had botheredthem were 'killing animals* and 
•leaving people to die, ' if they also continued to say they had learned about sych ^ 
matters in social studies the year before. There were also small fractions of . 
former non-MACOS students a year later who still indicated they had been 
bothered or upset over certain topics (e.g. , slavery) that they had studied the 
' year before, • . ^ ^ 

Students were of different opinions about thfe suitability of various 
topics for their age group to study. The mnia themes expressed (if not a flat 
yeg or no about suitability) in interviews with both groups were that students 
should have options, ^and that much depends on how the teacher handles a topic. 

If the teacher made an^effort to treat a topic seriously, not to respond to 

^ , 0 ' ^ - , 

. ^ sensational aspects, and to help students see^the various implications, <?tudents 

felt that otherwise emotional or vivid topics could be handled Qonstructively 
^ .. 17. . • 
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by most people their age. - * * * 

In follow-up interviews with 50% samples of students from each class 
conductec! in October the next year (five months after MACOS), students were . 

.asked if they could remember anything that upset or excited the class. A far 
greater percentage of MACOS classes (77%) than non-MACOS classes (11%) 
gave examples we categorized as goryx^ustoms or behavior of animals; For 
MACOS students examples of these were typically what the Netsilik ate and how 
they ate; howjhey killed and skinned animals; baboons tearing food apart; 
herriog gulls regurgitating food for their chicks. For non-MACOS classes' 

. examples included bull fights, cannibalism (the plane crash inihe Andes),, and 
human sacrifices. Classes in both groups mentioned topics falling into ti^e 
categories of exploitation of people (e. g. , slavery), and cruelty. 

Subjects or events that were recalled as pbrtieularly exciting by 
MACOS classes included making igloos, games, going.on an archeological dig, 
films (especially on salmon, and on the family life ^nd social organization of 
baboons), and discussions. Non-MACOS classe^g recalled excitement over * 
making dioramas, pottery, pinatasj. Russljyijjidjrapanese-life^^ 
trips, group work and projects^ discussions and debates. 

A greater variety of »other negative topics or events was recalled by non 
MACOS than MACOS classes'* These included: crim^ a movie on sex, debates 
'over money^madeby athletes, Vietnam, bussing, hunger and starvation in 

mother countries, pollution, voting, fish-bowling sessions (personal questions), 

. conditions in ghettoes, conditions in coal mines. Some MACOS classes fnen- 



tioned that .the class was upset over matters such as: MAC06 was boring, 
Eskimos -all sleeping together on a platform, the teacher asking personal 

\ ' 'is 

questions. . ' . 

It may be noted that no statement cart be made from the data of this 
study abbut psychoiogical Impacts, short-term or long-tejm, positive or ^ 
negative, of MACOS or any other program. The data show that there were topics 
or situations that some students reacted to strongly* They also show that 
fifth graders in both groups were more, likely to react more strongly than sixth 
graders to vivid scenes or sltuatlons^n questionnaires and In Interviews. 

Social studies, perhaps more than other subjects, does have the 
potential for engaging in'important issues and poking strong reactions.. 
Attitudes Toward classes During the Cdurse ^ *' r 

MACOS affected attitudes toward classes. Midway through the year,' 
three njieasures of classroom climate ( satisfaction , apathy, and difficulty) , 
based on students' ratings, were obtained. MACOS classes, on the average, 
compared to non-MACOS classes,- had significantly more positive ratings on. all 
; three measures. The three measures were highly intercorrelated. Thus, a 
conservative interpretation is that MACOS classes, on the whol^, tended to like, 
their social studies course more^hat^^ 
There was^of-course, a^aiitribution of such reactions in both groups. Some 
non-MACOS classes were far more positive than some MACOS classes. *The 
averages, however, favored the MACOS group of classes. 
Attitudes Toward the Course in Retrospect ^ 

The following year (in October), former MACOS classes were signifi- 
cantly more likely, on the average, to' find their^resent social studies prograift 



less interest ingt compared to the previous year, than former noa-MACOS 

9 

classes found theirs* Considering the variation in amount of ic^|^fi?ertation 
of MACOS^per se, at least some of that reaction must, of course, have had 
to do with^the teacher and with how the c6Urse as a whole had been conducted* 
A year after taking MACOSt former MACOS students tended to give more 
positive recommendations about MACOS than former non-MACOS students gave 
about their prior courses. Former sixth grade (the older students) MACOS . 
«^,students were more positive than former fifth grade MACOS students. This 
again suggests that MACOS tended to ^more appropriate tor older students 
with respect to interest as well as achievement. 

In the first follow-up,* former MACOS classes we^e less likely than^ * 
non-MACOS classls>^o feel they had missed spme-contetin^ subjects) 
that would now be useful to them In social studies. The topics that appeared to 
stand out for non-MACOS students had to do with animal behavior, and with 
similarities and differences in ways ardmals and peoplebdiayie^There^as some 
' Indication from MACgS^tudentsTliariea^^ history and customs of 

the United States and other countries would have been advantageous to them in 
their present programs. " 

. . There was some Indication fronvformer MACOS students In the first 
follow-up that some students would have found it advantageous now in social 
studies to have had niore oppor' mjty to learp~>how to make or use maps, )iowJo 
make or use graphs, how to find Information In the library, and how to write 
reports. When class averages of ratings of thepr.esent advantage of having 
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learned these and other skills were considered, the differences between the 

Ik ^ *, • 

MAC06 and non-MACOP groups were marginal, but" still suggestive of the . 

tendency just described* , 

Students from the former M/TCXDS and non-MACOS classes were 
asked in an interview, in the first follow-up (OctobW), to describe what they 
missed fpom last year's social studies class. The predominant response from 
classes in both groups was group work, projects, and art work (MACOS, 58%; 
non-MAOOS, 56%). There were major differences, however, in the percentages - - 
of classes In^the two groups mentioning other categbries of things that were 
missed. * Forty-four percent of the MACOS classes mentioned missing the course 
ontent, or what they had learned or read about (compared to 9% of the non-MACOS 

classes). Forty-four percent of the MACOS classes, compared to 13% of the 

\ .1 ^ 

non-MACOS classes, also mentioned films they had seen. And 31% of the MACOS ^ 

\ ^ 
classes, bompared to 9% of the non-MACOS classes, mentioned missing games 

and plays. Egugl percentages of "classes agreed that they did not really miss 

anything from l\^t year (MACOS, 12%; non-MACOS,^ 13%). 

Discussions were iriention^d^-fcy 39% of the MACOS and 33% of the non- 

• \- ^ ^ • - 

MACOS classes., Discussiohs were. more likely to be mentioned in both groups 

by former sixth grade than fifth grade classes. MACOS fifth' grade classes, 

however, were much more likely to mention missing the games and plays, as well , 

' \ .. ' . . % 

as course con<-et{t (what they had learned), than MACOS sixth grade classes. 

MACOS sixth grade classes were, more likely to mentiop group work, ^projects, 
and- art work than MACOS fifth grade^classes. Both gra^e levels 6f MA^OS " 
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■ • classes mentioned the films equally frequently. 

These results strongly suggest the vividness that MACOS bad for many* 
students* The content stood out in mind, as weft a& some aspects of the 
methodology. But they^also give fiirther indicfation of grade level differences- ^ 
In reactions t^ the course. Tbe'older students (fornier sixth graders), for , 
example, seemed to havfe been more challenged and engaged Jby discussions, on 
* the whole, than former fifth graders,* if .one uses'rtetrospection as an indicator. 
The same relationship occurred. in the non-MACOS group of classes, although 
not as markedly. The greater stimulation of discussions (or sixth 'grade classes 
' may Jiave been because it was a more frequent activity than it was for fifth grade* 

clafi|ses.^: But there may well also be'a maturation factor involved. 

« • ^ ' ' *. . 

Attitudes Toward Social Studies in Geoeral 

~~- ~ ^"^ * ■ . • • 

MACOS seemed to iiave,a 'temporary p'ffectV)n attitudes toward, social studies 

. in general. MACOS classes, on the average, scored higher at pretest, than 

non-MACOS classes in preference for social studies, compared to other subjects. * 

MACOS had already started when the pretest instrument was given.- Results may " 

' have reelected initial enthusiasm for q different course. The attitude of MACOS 

classes at ppsttest, once pretest was taken into account, was not significantly 

moye positive, on the average, than non-MACOS classes. A year after the MACOS 

and non-MACOS courses, there were no differences in any sense between former 

. ' ^ ^ ^ . . ' ' • ' 0 

MACOS and non-MACOS^clas§es-on this measure. Both groups of classes, a 

year later, 1iad slightly positive attitudes, on the average, toward social studies 

/ ' ' ■ ' . i . • ' ' 

when asked to ra^e how* much they liked it ior itself, not In comparison to other subjects. 

' * ' ^ \ ' . / 

. ' ' - ' j 22 ' « ' . * . 



' Atttiudfeg^Toward Social Studies Compared with gher Subiegts * . 

It was found that during tWe year students took MACOS, sfarth grade 

MACOS students showed a'greater relative increase in t)reference for social . 

♦ • 

r ' . ■ . • • . - 

studies, feompared to other subjects, than ttfth grad^ students. This is taken 

■ l"" ' ' I - \ r 

as fdrther indication that MACOS tended to be mor^it^^ropriate for sixth graders 

than for fifth graders. For both groti{jr'-and grade* IfiVels occept MACOS sixth . , 

graders,, social studies-starte<land ended ranking .fifth in preference (after 

arithmetic, scielfeer-tea^iig and speliing). Only English consistently ranked 

lower.ln compara'tive preferen^^sf^ For ^COS sUrth graders at the end of the , 

cburse, social studies rank^ fourth, followed ijy spelling and English;\ (1^ 

all-groups. of students, reading and arithmetic tended to be the prefeTredjubjects, 

both pre and po^, when students had to choos^, witfi science. running a close 

thitd).^^^e general conclusion, is that, while.stiicTents did not, on the average, 

.positively dislike social Studies, social studies ranked low in preference when 

com^iared with other pourses. There was evidence of a temporary increase 

in preference for social studies among MACOS students, particularly sixth grade 
• » 1 J ■ » ■ 

ones- By the measures and methods of this study, there Nfrere no general enduring 

, effects on attitudes of classes toward social studies beypnd the year 6f the course, 
.although, as\Kasbe^ noted, former MACOS classes, on the average, found the 
next year's qlass less interesting by comparison than former non-MAGOS classes. 
Relevance of S'ociaf Studies , . - • - - '(^ ' . 

We'fouftd,.from interviews with students, no general differences between 
MACOS and nonrMACOS classes./on the average, in what they, thought was important 

. . . - .23 ' . \ • . : ' 

-• •. - .■ ■= . ■ .\ .53, • . ' - • . - 



about soctal studies, or why tliey should study It.' ThV prevailing opinions had . 
to do either with an immediate personal advantage O'becausfi it's interesting to 

•^ • • * -.a 

know**) or a personaUong-term advantage ("so if you are. ever in a country, 
you;il know how to act," or "^so we can tell our children")..* 'Relatively few . 
students mentioned scholastic necessity as a reason. Social: studies 
educators may call the personal advantage reasons "appreciations." The term 
piat struck us was "consumerism." Consumerism in this context means when . 
studentp gave a reason for tjie importance o^ studying social studies, -they tiended 
to cite examples having the-folliwing characteristics:, it is interesting to know now, 
^nd it may be useful to kpow some day, either persona'Uy or for informing one's 

children. . ; ^ 

Despite the competing influences of television, books, movies and' 

increased "travel opporfurtities, we were convinced from interviews with students, 

' . ■ 

that many ^though of course not all) found subjects presented to them, inherently 

• I ' ■ ■ . ■ 

interesting, "no matter what the subject. Authenticity iSeemed important, whether 

it concerned Greek myths, or Netsilik boat-makii-g procedures.- Currentnes> also 

was imbortant to -many students. For example, some stuaents, on reflection 

five months follov/ing a cour^^ would state matters in terms of connections with 

' ; . / ■ ■ . • ' r . 

current life or events ("almost nobody* stops you on the street to ask you, for 
^^examrte. about the (Netsilik) or the (Micmac Indians)"). *^ Such students appeared 
to want to be abreast of what was currently newsworthy or seemingly relevant to 



* Not literal quotations. , , . ... 

Again, not^direct .quotations, 4)ut the gist of some statements. • 



.thete' lives. ,Spho^,^ howeyej^ could compete with^ther sources of information 

\ - o 

wtth many fifth and sixth grade students in terms of engaging interest and attention 
in virtualls^-any'sidbject. 

Artalysis of interview data shjowed that in MACOS, and non-MACOS groups 

■■ . i , ^ - ■ • 

alike, social studies had an influence particularly on television viewing. MA€OS 

. • ■ ' ■ - f ' ■ ■ ' I . 

classes were far more likely to pay attention to animal programs (e. g. , Jacques 

Cousteau); npn-MACOS classes were far more likely to report watc\iing historical 

(or contemporary) dramo'^ that were related to what they were studying. It was 

telev^ision viewing, more than any other source outside school, upon which social 

studies in both group's (MACOS a,nd non-MACOS) seemed to impact, according to 

interviews with students* ^ ^ ^ 

There was little evidence that social studies as seen in this study produced 
or attempted to produce social activism. Non-MACOS, more than MACOS courses, 
appeared to' impel classes in this study to action. Of the two classes in the study 
that actually went out and tried to take concerted liStion based on what they had 
learned in social studies,- both were non-MACOS classes. -The precipitating issue 
was the problem' of abandoned animals as presented by the SPCA. ^ 

Studpts of course did talk about social studies outside school. According 
to analyses of interviews conducted inJ^ovember/Dec^mber, twtf months after 
pretest, students in both groups were most likely to talk about social studies with 
.parents, friends, and siblings, in that order of frequency. Surprisingly, however, 
the samples of s'tudents in 34% of the classes in both groups said they did not talk 
w'lth their parents about social studies at all. 
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^ Whea students did talk about social studies, the predominant subject 
w&s, of course, what they were learning in school: facts, i^ormation, 
generalizations, etc. typical discussions appeared to be descriptive, or a 
sharing of information. Students from both groups would also mention discussions 
that we classified as discussions of issues, debates, and arguments over values 
or opinions. Discussions of this kind were mentioned at least once in 58% of the 

MACOS classes and 37% of the non^MACOS classes. 

. ' ^ . - ' 

Students in both groups mentioned hearing people talk about things that 

^ ' ^ ! • ^ 

remihded them of what they were studying in social studies. The examples given 
were curriculum specific. MACOS classes were far more likely to mention ^ 



animals; non-^^COS classes were far more.likely to mention history^ 
historical figures^^countries, customs, et^- Somewhat Jnore MACOS than nqn- 
MACOS classes cited news, current events, elections, politics, sbcial issues 

as something they Ijeard talked about outside school that reminded them of 

I - - 

social studies. > . . ^ • ^ ' 

^ Finally, stiidents in classes from both groups often could describe 
doing something outside school because of'what they had learned or studied in 
social studies* Activities included seeking further infornriation (reading, looking 
at exhibits In museums^:! doing.something that drew .on knowledge or skills related 
to social studies (e. g. , |naki;ig a map for a game): or doing or seeing things 

initiated by others (familV, scouts, etc. ). 

\ I 

The implicatior; of the foregoing is clear. There were many linkages 
perceived.by students between what they studied or did in social studies in school 
and what they saw, and heard, and did outside school. The sense gained from 

i 26 
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students' examples and descriptions is that social studies tended typically to / 
serve both as a supplier of information (and, to a lesser extent, skills, such as 
making or using maps) that enabjed many students to feel that they had something 

to contribute to general or adult discussions or activities, and as a pointer that 

: II ' " ' • ' ^ 

led students to attettii to subjects, events, or details that might otherwise have • 

passed unnoticed. The data do not allow inferences about what students made of 

what they learn, how they interpreted it, or what cognitive or value systems were 

developing. ' 
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CHARACTERISTICS OF THE TWO GROUPS OF CLASSES 



* ' We turn now to the chai^acteristics of classes in the MAGOS and 
non-MAGOS groups. The three questions of interest in this study were: were 
there differences between MACOS and non-MACOS classes? to what were ^. 
theyxelated? did they have any relation to outcTbmes? 
Initial Characteristics of Classes; Inputs 

There were not significant differences'. between the-two groups-of- ~- 

classes, on the average, with respect to pretests of achievement or of attitudes 

(excepc for preference for sociar studies, as noted earlier). Nor were th_ere 

differences between groups in the demographic characteristics or composition 
of classes. Both groups included classes covering a range of demographic 
compositions and sizes. The typical class in both groups, however, was pre- 
dominantly white and n6n-low income. * The groups were similar with respect 
to the amount of teaching experience of teachers, there were indications of 
differences between the two groups of teachers with respect to 'educational 
philosophy (non-MACOS teachers tended to'score higher on the average than 
MACOS teachers on a measure of traditionalism, but the groups were similar 
on a measure of progress ivism), '^'^ and on the apparent importance of different 



* The indicator of the economic status of a class used here was the percentage 
of students not eligible for the free lunch program. . 

** Traditionalism, given the items on the Educational Scale VII. instrument, means 
a tendency to favor discipfine, authority of the teacher, mastery of content, 
^earning organized around subject matter, competitiveness. Progressivifim' 
means a tendency to favor problem-solving over content,- development of good 
attitudes, individualization, gearing learning to students' interests and life 
experiences, interaction' of students. In general, traditionalism here suggests 
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broad categories of social studies objectives- MA COS teachers were more 
likely than non-MACOS teachers to consider a wide range of objective as 
important However, when all measures of pretest, class characteristics, 
and teacher characteristics were considered together, differences between the 
MACOS and non-MACOS groups 5f classes did not approach statistical slgnif- 
Icance. It was concluded that the two groups could be considered comparable 
at thp outset with respect to the cluster of variables empl oyed. This average 
similarity of groups, however, should not be taken to diminish or obscure the 
diversity of classes within e ach group. » 
What Was Done in Classes: Processes . ^ 

According to ratings made shortly after mid-year by students and by 
teachers, there were differences between groups in perceived emphasis on or 
frequency of certain kinds of activities and other characteristics (called '^process 
in this study. There did not appear to be differences between groups in other 
activities and emphases. On the average, the MACOS classes, compared to the 
non-MACOS classes, were rated by students as: 

giving. more emphasis to comparing things to see how 

they are alike or different;' 
^ • putting less emphasis on grades; ■ . - 



a mete authoritarian, work-oriented approach build around subject matter, 
progressivism-suggests a more democratic, problem\solving approach, 
built arbund life experiences, the^'clevelopment of po^sitiye attitudes, and 
individual needs arid interests. " / 



having jnore emphasis on discussion 
• ' involving more frequent talk by the teacher 

putting less emphasis on synthesizing activities (e. g. , 

«> - . - ' • * 

making up new things from what was learned such as stories, 

•* 

ppems,' plays, reports, etc.,, or thinking up new ideas or. 
examples). . , . 

• The two groups of classes did .not differ significantly in 



perceived emphasis on: 
\ • memory (e.g. , in social studies, our teacher really makes 



us remember the names, new words, and facts that we have 
learned); 

translation (e. g. , our teacher always wants us to tell, about 
.^^^ - things ini our own wotds in social studies clasfs); 

interpretation (e. g. , it isn»t enough just to learn facts in social 
studies; ojar teacher also want^'' us to decide what the facts mean 
to us); ' < ' 

• * application (e.g, , the things we do and learn in social studies 
really help me a lot ip other classes*and outside school too); 
analysis (e/fe, , in social studies, we always have to study all the 
parts or sides of a question before we decide what we think); 
Valuation (e, g. , in social studies, we often have to decide if 
thinfes in^the world are good or bad, or right or wrong, and tell 
Why we think^o), ^ - ^ ~ — 
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The tWo groups also did not differ significantly, on the average, on 
rgtlhgis by students of the appropriateness of the pacing of the- cl?ss (going too 
slowly, or too fast)"; of the extent of listening done; and ,of degree of informality 

or joking. ^ • . 

With all the ratings of process (and classroom climate) characteristics 
by students there were variations in ratiags^betweea students within a class. 
When the student ratings, were 'averaged to produce a "scortf' or average for the 
class, there were Variations among classes within the MACOS and noh-MACOS 
groups. The similarities and differences between groups reported here refer to 
average similarities and differences in the average of class means for the two 
groups of classes as' a whole. ^ ^ 

MACOS. teachers, significantly more than hon-MACOS teachers as a 
group, rated their curriculum higher in emphasizing affective content, application, 
analysis, and synthesis. They rated their curriculum less in emphasis on com- 
prehension; and similarly to non-MACOS teachers , on the whole, in emphasis on 

memory, evaluation, group, activities, and individual activities. ' 

The emphasis perceived by students pii comparing and on discussion, and 
Tthe comparative lack of emphasis on getting good grades, are three characteristics 
• that appear consistent with MACOS design goals and philosophy. That MACOS . 

class e;^ compared, to nldn-ivifACOS classes.saw the teacher as-talking more', an^ 

as having less emphasis on synthesis activities.are results which do no! seem 
-con^st^nt with MACCS^desigiLgpjis, and, philosophy. '''Co the extent that the ratings 

made by students were valid indicators of typical emphases or characteristics, 



1 
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. the results suggest areas that may be of interest for teachers., supervisors and 
others to consider In program planning and staff development. \ 

' ■ - \ ■ 

Direct and repeated observations of classes could have helped clarify 

- 

• some of these^ results. The limited observational data that could be obtained 
' " and analyzed are at least suggestive. A random sample of transcripts of MACOS 
and non-MACOS classes, taped In November/December two months after pretest^ 
was analyzed, using the Aschner-Callagher coding system. Only teacher state- 
ments and questions were coded. The samples Wjere small(9'MAGGS and 10 non- 
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MACOS classes), and so the lack of statistical difference in results ^was not 



unexpected. However, the average frequencies of types of statements and » 
questions in both- groups, of cliisses were very similar. Other than statements 
having to do with classroom routine, the predominant type of statement or question 
had to do with cognitive memory. Th^ next most frfequent Jfcype of statement or 
question was classified as convergent thinking — - directed toward a single answer 
or point. Divergent thinking and evaluative thinking questions were relatively 
infrequent in both groups. There was indication that, cognitive memory questio;is 
were a littlo less frequent, and evaluative thinking questions a little more 'freqient 



in the MACOS sample than in the non-MACOS. The average number of teacher 

1 

questions and statements was slightly greater in the MACOS than "in the non-MACOS 



sample. * c 

* * • c 

^ These results, which of course apply only to a single class^period,! and 
only to a small sample of classes in each'group, -nonetheless have interestinfr 
. implications. One reason why there may not have been differences between \ 
•students' perceptions of emphases in MACOS and non-MACOS groups of classe.^ 
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with respect to memory, translation, interpretation, aflalysis, and evaluation is 
that there may not have been substantial differences, on th'e whole. In light of the 
fact, however, that there were average differences between groups in classroom 
climate, and In perceived emphasis on grades, and on discussIpUf it is possible 
that the same types of emphases or activities were carried out.differently In the 
two groups, and thus were reacted to differently by students. It Is also possible ^ 
that the content of MACOS tended to.help make otherwise similar processes have 
a different effect 6n the attitudes of students towards the class,. 
■ — . A second implication of the results of analyses of the samples of class 
ti'anscripts Is related to the^slmllarity in development of Inquiry skills that seemed 
on the whole to characterize the two groups of clanses. If underlyirjg methods and 
emphases were in fact similar, on the av^age, it would not be surprising that, 
as has been seen, the development of resultant inquiry skills would be similar, 
and that attitudes towards ambiguity in problems or Interest in problem-solving 
would be similar. 

Results of Variations in Amount of Implementation of MACOS 

How did variations in amount of implemen/ation of MACOS (e.g. , per- 
centage of lessons taught, amount of time spent); affect outcomes? Analyses, • 
using class means, were made of the MACOS classes %r the two parts of the 
MACOS test ( Man and gher Animals; Netsilik) at posttest, and for the Mad and 
Other Animals part in the seconfl follow-up, a year after MACOS. The results 
were that: 1) pretest class means on the Man and Other Animals sub-test was 
the most significant predictor of posttest performance in all three cases; 

6 

2) pi*etest scores on the Netsilik part of the test wa^s not a significant predictor 



oif performance in either sub-test at 'posttest, or for the sub-test used a year 

later; 3) thp percentage of Man and Other Animals lessons taught was not.a sig- 

. . ■ J V - 

nlficant predictor of performance in any of the three cases; 4) the percentage of . 

Netsilik lessons taught was a signiffbant predictor of performance on the Netsilik 

V 

sub-test at posttest; and 5) the percentage of sixth ^ratlars in a class was a pre- 

' ^- ^ • , ■ ■ 

(Jictor of performance on thef Man and 'other Animals sub-test, but not on the ^ 

Netsilik sub-test (i. e. , oldei students did better on the part of the 'test containing ' 

items dealing with some of the more abstract concepts of the course). 

•These results suggest that the Netsilik unit provided students- with more 

new and readily understandable information than the Animals unit. 

Suppose all posttest measures are considered simultaneously In relation 

to amount of implementation (with the Implementation variables also considered. 

simultaneously)? Would there be significant association? The answer is that 

there was a significant relationship. But the outcome varialDles that w are most 

»■;*.•■.■•■ , 

strongly associated with aniount of implementation of MACOS were posttest 
attitude, not achievement variables. * Of the attitude outcomes at posttest, the , 
most strongly associated was interest in problem-solving, followed, in descending 
.prder of strength of association, by preference for social studies, and attitudes 
towards unusual, hypothetical customs or beliefs and towards people «r groups 
• that would have;such customs or beliefs. The MACX)S test, the Interpretation of 
Data test, and the STEP had much weaker associations. ** The results suggest 



' * It should be noted that pretest measures were not included as predictors in. 
this analysis. ■ 

** Technically, the index of association used here was the correlation of a variable 

with the criterion variate in n canonical correlation analysis. 

■ ^ 

■ .34 ' 



that when posttest achievement and attitude outcomes were considered together, 
it was attitude outcomes rather than achievement outcomes that were the more 
likely to be influenced positively by increasing amounts of. implementation of WtACOS. 
Relationships Among Variables ' 

Aa analysis of relationships among variables shed some light on the 
factof«f^ffecting learning outcomes* For instance, there were relationships 
between what was done in classes (processes) and certain ^attitudes at posttest and 
in follow-up. There were relationships between initialocharacterlstics of classes 
(input) and what was done in class (process). The following descriptions are based 
on analyses using principal component "scores" for sets of variables. * A principal 

component is a weighted cbrrposite '\scortf' for a group of variables. For example, 

' «^ ' « 

all the clasi^room process riieasures bbsed on student ratings, convert.ed'to class- 

^ ' . 0 ^ - ^ r ' 

room tiverages, were combined to produce two composite jscores by a method 
somewhat like factor analysis. Given these two principal compbnent score equations 
feach class could be assigned two VscoVes," one forlhe first principal tfomponent, 
the other for th'e second. The principal cariiponents were used to examine rela- 
tionships among variables (they werq also used in major analyses of differences 
. betwe^n.groups). * When a principal compbnent appeared to have a significant 
relationship to some oth6r vari*le or vori^ibles, exl^minntion was made of the 
ih4ividual variables "that were particularly related to the principal component. 
Therefore', when we mentioi particular variables below, it will be.jinderstood 



— ? • . - - • 

*• Principal components were also used as covarigtes in analyses of outcomes, 
' and in analyses at initial differences among groups. 



that the variables were parts of a composite score. * 

BelatioDs of Beginning Aptitude of Students and Attitudes of Teachers to Outcbm^es 

♦ 

Not surprisingly, begiahing aptitude (pretest) was the most important 
factor in posttest, results as far as achievement scores (class means) were con- 
cerned* Pretest' score was not always the most importaut factor with posttest 
ttitude scores (again, class means). In some c^^^, posttest attitude scores 
were much more likely to be associated with variables such as teacher attitude. 



classroom processes, and classroom* climate. 

Teacher attitude^, as measured at pretest, were related to posttest class 
scores of attitudes toward unusual, hypothetical custonas, beliefs or ^ehavior^and 



toward tolerance of ambiguity in 

V 0 ' 



Droblems. Ther.e was also indication of a rela- 



tionship of teacher attitude to performance on the^IvIACOS test at posttest. In all ^ 
these cases^ the. higher the traditionalism scores of the teacher, the poorer or-Vess 
positive the posttest outcome score. The same relationship held for attitu^^s 
toward people w^o might have uausual .beliefs or customs measured In^llfe final 
follow-ujf), a year later. ; ^ - ^r * 

• Interestingly, -the more ^focussed. the teacher's [objectives (the less* th(^ * 

» - i * -I ^ 

teacher tended to see a wide variety of objectives as..eqtially important), the 

: ' ^ V ^* \ > 

better the class scores on the MACOS testm the final Jollow-UR, a year\after the 
posttest. On the other hand, the more generaj^he teacher, the^ore positW the 
clajss scores in the final follow-up on attitudes- toward'^unusual customs or beliefs. 



* By way of Illustration, the three classroom climate variables formed one 
composlte'^^'score,*' i.e. , one principal component. Thus,^ reference is made 
to "cUmate" with the undeVsttimlir.g that it is macfe up of the'three scales 
already/described: satisfaction, apathy, difficulty. 
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tIwis, teacher attitudes did seem to influence results. But when relation- 
. , ' ' . ' • ' * I 

ships "of studetvt and teacher pretest characteristics to results were analyzed/ 

Simultaneously in the MACOS and non-MA(^ groups separately, it was the student: 

.aptitudes (pretest scores) that were by far the more Important. 

. * » , \ , 

Classr6om Climate ' ^ 

. ' Cla:^5room climate was significantly related to posttest performance on 
the STEP test, and on the Measure of preference for social studies compared with 



other subjects. Climate was also significantly related to, class average ratings at post- 

- ■ • . " ' ; . • I 

t6st 6f ability of self 'as probiemVjlvfer. A year later, classroom climate, measur^ 
tife prior year, .w^ significantly reldted to a 'measure of how well last year's classes 
now j/ked social studies ger s6. These relationships, however, pertained predominantly 
to tWe non-MACOS group. The Invariant relationship between classroofti climate and 
outcomes was that the better the climate, the better or more positive the outcome. ^ 
^Classroom Processes (Activities and Emphases) » 

Composite measures of classroom process variables were significantly 
related to class posttest reactions to unu»%wl, hypothetical customs, beliefs or • 

% 

b.ehavior, dnd to persons or groups that would ha ve such customis, beliefs or ' ^ 
ijehavior. They were also significantly related to ^sttest attitudes of tolerance 
for ambiguity in problems. The following year, in pctober, prevfous classroom, 
process measures.were significantly related'to opinions of classes abdut whether 
subjicts or skills they had learned the year.^efore in social studies were benefitting 
thehf in their present courses.. They were also related to how interesting students 
from formet MAC<)S and non-MACOS class(ig='found their current social studies * 



classes, compared to their previous class* 

Whea the two groups of classes were analyzecl separately, it was found 

that after input had been accounted for, it. was the non-MACX36 group of classes 

in which the process and classroona climate variables showed sjgnificant relation- 

ships toithe outcomes dtaoribed. The finding is interesting especially since it 

pertains primarily to i>jlilude outconies. It suggests that the outcomes of the 

MACOS classes, taken •\<i a group, seemed to be less affwted by variations in 

perceived classroom processes and classroom climate than outcomes of the 

non-MACOS classes, taken as a group. This*, of coutse, does not apply to any • 

specific non-MACOS class or curriculum;' only to all considered together. Nor 

does it apply;, by. the same token, to any particular MACOS class; 'only to the ^ 

\ - ■ . ^ ■ , - - 

MACOS classes taken ah a group. - 

- * ■• ■ / ' ' . . . 

One should not conclude that classroom processes or classroom climate 

* • . • . " ' » 

were pi no Importance at all in tKe outcomes of MACOS classes. For example. 



> 



analvsLs of relationships of process and climate variables considered simultaneously 
.suggested, for the MACOS classes, thai the perception of the class as mformal, . 
without- stress on grades or tests, and without 'emphasis on particvlarfoYms of 
activity sach.as remembering facts, putting things in your own words, always / 
giving good reasons, and the like, were important factors in some follow-up , , 
attitude and achievement outcomes. It wi.s also important if the teacher did not 
perceive the curriculum as emphasizing knowing, /remerabering'and individual work. 
• The important elemeftts in the classes, in'this study appeared to be I) teachers 

- v^ho tended to hold traditional views of education, and who felt their curriculum 



emphasized basic cognitive objectives, and 2) classes that were perceived by 
students as having, relatively little opportunity for discussion, little emphasis 
onjDomparing things, little emphasis on interpreting what things seem to mean, 
and little emphasis on evaluating (trying to decide what is right or wrong, good 
or bad)/ These combinations were apt to be related to outcomes, particularly 
to poorer attitude outcomes, at posttest and in follow-ups. The relationships 
appeared stronger in the group of non-MACOS than MACOS classes. 
Factors Related to Good Classroom Climate 

Suppose one regards classroom climate as an outcome? What prior 
factors seemed to^^influence it? Generally, Classroom clinji^vte was related to 
the attitudes or orientations of teachers, i^nd to how students perceived the 
emphases and activities of their classes. The lower teachers scored on a 
measure of traditionalism and on approval of controlling behavior, the better 
l¥e climate. The less the class was perceived by students as traditional 
(emphasis on. grades, right answers, facts, individual work), the better the 
climate. Classroom climate was not related to pref'^st achievement levels of 
classes. There was a relationship with pretest attitude. The more a class at 
the outset perceived iteelf^as interested in problem-solving, and as creative, 
the less difficult the course vyas perceived at midyear. Classroom climate did 
not appear particularly related to the demographic characteristics of classes. 
Relationships of Initial Characteristics of Classes to Subsequent Processes and Climate 

^ There wap indication that initial characteristics of classes were related 
to classroom processes (what was done, and how) and classrpom climate. The 



\ I 



relationships were somewhat different iathe MACOS and non-MACOS groups.^ In 

• ^ ■■-/•' 'I 

the non-MACOS group, the better the scores of the class in achievement and attitude 

' ■ ■ ' ' V ' J~ 

at pjfetest, and the lovyer the score of the teacher on traditionalism measures, the^ 



less the teacher tended to indicate that the, curriculum emphasized lower order ob- 
jectives (e. g. , remembering, comprehension). There was some indication that 



1 - / 

classes were also perceived by students as tending to be informal, without stress on 

/ 

grades. There was also 
pattern. 



a strong relationship of good classroom cliniate to such^a- 



In the IVIACOS group, the older and more affluent the class, the younger 



/ 



the teacher (or more specifically, the less total teaching experience), and the lower 



the teacher's scores on tracjitionallsm measures, tlien: the more the class was per- 
ceived as informal and iiot stressing grades,, the I.ess it was perceived^as emphasizing 
tr;aditional activities,, the more the teachers! indicated the curriculum emphasized 



affective and higher-order cognitive objectives, and the better the classroom climate. 
Pretest achievement levels of classes boreisome relationship to processes; pretest 



attitude measures had little or no relationship, on the whole. Again it should be 



remembered that these relationships in bothWoups pertain to the groups of classes. 



not to any specific class 



The interpretation offered here is that teachers who used MACOS with 



oldei^,' more affluent daises were better able to' establish classes that were per^ 



r^ 



ceived by students in way^ that were consistent with the 'community of learning' 
thrust of MACOS. Furthermore,^ the MACOS teacheics* perceptions of em- 
"pfiases^and activities tendid to be more consistent u^th those of students than 
was the case in the non-MACOS group. The relationships were less clear in the 



non-MAC^^roup, very possibly because cfflhe diversity of curricula. In both 
groups, it appeals^ important that the teacher not have a traditionalist attitude, 
9ertainly if good classroom climate was desire<?. 

To summarise, there were relationships of achievement and atti*^nde 
measures (outcomes), at posttest and in follow-up, to what went on in classes 
(processeaj and to climate. The relationships of processes and classroom climate 
were stronger with attitude than with achievement measures. For example, attitudes 
of students toward social studies were more strongly related to classroom climate 
than were the various achievement measures. While there were differences in 
process and climate measures between classes within the MACOS group (as well as 
within the non-MACOS group), the outcomes of non-MACOS classes generally showed 
a stronger relationship td variations in processes and climate than the MACOS 
classes. The attitude or orientation of the teaqher was important in both groups. 
Lower traditionalism scores went along with more positive perceptions aird 
attitudes by students. There was indication that the same t3rpes of emphases and 
cl ass'act ivitiea were apt to be perceived differently (and more positively) in the 
MACOS classes than in the non^MACCS classes. 




• TEA-CHERS 

Demographic Characteristics 

As groups, the iviACOS aVd non-MACOS teachers were similar (according 
to data provided by them on a background form) in a number of characteristics, 
although the MACG^ group had more male teachers (47%) than the non-MACOS 
^oup (35%). All but three teachers w.ere white. One'^te^cher in each group 
was black,, and one MACOS teacher was oriental. The median age of the 'MACOS 
teachers was?> 29, of the non-MACOS teachers, 28. Six-percent of the MACOS 
.feachers were over 50; 10% of the non-MACOS teachers were. Thirteen percent 
of the MACOS teachers, and 21% of the non-RIACOS teachers, identified with an 
ethnic minority. Seventy-six percent of the MACOS teachers and 67% of the 
n6n-MAGCS teachers held Bachelor's degrees; 9% of, MA COS and 12% of non^ 

9 

MACOS teachers, held a Master of Arts in Teaching; 19% of MACOS and 18% of 
non-MACOS teachers held other master's degrees. ^ 

> MACOS teachers had'^in average of 9 yeal-s ^teaching experience 

(range: 0^33); non-MACOS teachers had an average of 10 years experience 
(range: l-:40). Both groups had taught in their present school districts an 
average of 6-7 years. Both groups had taught their present program an average 
of about 2l years. However, the range of years' experience was much different 
(MACOS had only recently been developed): MACOS, 0-4; non-MACOS, 0-16. 

Eighty-three percent of the MACOS teachers and 75% of the non-MACOS 
teachers had had a social studies methods course before becoming teachers of 

record. Sixty-seve<8 percent of the MACOS teachers and 48% of the non-MACOS 

• * * ' 

' 42 ■ 



ERIC 



teachers had'some form of in-service training in teaching social studies. The 
great majority of teachers in both groups, when interviewed in February, indicated 
they were neither receiving nor giving social studies related trainings during the ^ * 

' year of this study. ""'^ - 

Forty-three percent of the MACOS teachers, aud 60% of the non-MACOS 

. ones, were in self-contained classes. About 45% MACOS and 38% non-MACOS 

- ... ^ 

teachers were involved in team-teachi; 5. Twenty-eight percent of the MACOS ^ 
teachers and 13% non-MACOS indicated they were involved in an open-space 
arrangement. Fifteen percent of the MACOS" teachers and 23% of the non-MACOS 
teachers indicated they were in a departmentalized situation. 

When, asked to state the one subject they most preferred to teach, 21% 
of the MACOS and 22% of the non-MACOS teachers said social studies. Twenty-- 
three percent and 20% of the two groups* respectively listed math or science. 
Twenty-eight and 30% tespectively listed combinations of subjects, some of. 
which included social studies.' \, - 

Who or What Influenced Teachers Most With Respect to Teaclfing Social Studies? 

During the second interyiew with teacheirs, teachers were asked v/hSi 
person or experience had had the greatest influence on their ideas about what 
social studies is and how to teach it. Some teachers mentioned several sources, 
but only the first was tallied. The most frequent source mentioned by MACOS 
teachers (31%) was the MACOS summer institute, workshop, or in-service 
training. The most frequently mentioned source by non-MACOS teachers (44%) 
was their ovl^n personal experience (no particular source stood out). Ten percent 

43 
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of the MA.COS teachers and 30% of the non-MACOS teachers cited ti professor 
or course(s) in college, or graduate school. Other sources mentioned by mem- 
bers Qf bcfh groups were: teaching a particular program (MACOS, Holt Data 

Bank,, Tpb^, etc. ); ani team members, colleagues, other persons* in the _ 

- f 

school system. A few teachers mentioned a former high school teacher. A few 
mentioned books they had road (e. g. , dasher's Schools Without Faitoe ; various 
social studies texts and series). No teacher mentioned the professional journals, ^ 
although that does not mean they did not read them or were not influenced by them. 

Teachers in.both groups who mentioned a source of important influence . 
other than their own experience were likely to indicate that the influence was in 
the direction of more openness, with more concern for concepts and relationships 
than with facts and dates. In both groups, regardless of the source mentioned, the 
describetd change was often linked to ways of making subjects^ interesting to students, 
getting subjects to come alive,. and getting students to see the relevance of what 
they were learning to themselves and to the world around them. 
Problems Confronted By Teachers , - , . 

Were problems faced by teachers in the two groups different? How 
changeable were programs inthe two groups? * Teachers were asked in the first 
interview (Noveniber/Dec ember) wliat they found to be the most difficult problem 
^-hey had had to deal with in teaching social studies at their particular grade 
'level. The two most frequently cited problems by MACOS atvd non-MACQS teachers' 
had to do with lack of student interest (32% MACOS, 51% non-mCOS), and t^q wide 
range of abilities of students (32% MACOS, 24% non-MACOS). The first category 
had to dp with lack of interest £e£ se, or because students could not see the 

44 
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relevance of social studies to their own lives, or with lack of interest because 
the materials, terms, 'concepts, etc. wer^foo difficult or abstract. The second 
category included such problems as the wide range of developmental levels, 
maturity, work skills, listening skills, ability to participate in discussions, ability 
to work together in small groups, and the like. Other less frequently mentioned . 
problems by teachers in both groups were: reading and v^riting skills, discipline, 
quantity or quality of available materials,, lack of continuity of program at earlier 
grade levels, low priority given to, social studies, and lack of clear social studies 
goals. Both groups also mentioned problems not as readily categorized as the 

above. ■ ' , 

The most prevalent solution offered by both groups of teachers focussed on 
the quality of the program (simpler, more, interesting materials; more field trips; 
more tie-ins to the needs and interests of students). 

, Overall, there appeared to be little difference in the kinds of problems 
teachers from either group described as particularly difficult. Some teachers, of 
course, said they could think of ho particulaWy difficult problem. ^ 

Non-MACOS teacherg, somewhat more than MACOS tpacbers," were likely 
\ ' ■ ' . ■ 

to have made what they considered important changes i a their programs from the 

■preceding year.\And non-MACOS teachers, much more than MACOS teachers, were 

likely to have changed or modified, their present program by November/December 

from what they had planned at the beginning (59%, compared to 33%). The kinds 

e - ^ 

',^b£^anges and the reasons for making tKem, however, were generally similar 
in bpth groups, if changes were made at all. 
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When interviewed the second time (February/March), the majority of 

• * . ♦ 

teachers in both groups' were very pleased with how.their programs were going. 
A number of teachers in both groups, howiyer, said they were behind where they 
bad-hoped to be by that time. A few teachers in both groups mentioned th*e lack 
,of adequate time for social studies as the problem. 'Several MACOS teachers . 
felt the Man and gher Animals unit was too long,, and a few teachers felt the 
course was not providing sufficient opportunities for students to develop basic . 
. study skills," or map ar^geography skills*. MACOS teachers were a little more 
Jikely than non-iVIACOS teachers to mention problems with group discussions, or 
with getting adequate student involveri!ent in group processes. Two MACOS * _ 
teachers had dropped the course due to lack of student response. Non-MACOS ' 
teachers were more likely than MACOS teachers to mention problems with^ 
availability of suitable materials. • " • -. 

In sum, teachers teaching MACOS in whole or in part were, by 
definition, working with-a different teaching situation from teachers teaching the 
' "variety .of other programs called non-MACOS in this^study. According to their 
descriptions, however, they foand themselves dealing with instructional problems 
no different, on the whole, from the non-MACOS teachers. They were less likely, 
as a group, to have male changes in their programs, according to what was said 
•about changes by both groups it. interviews. When they did make changes in their 
programs, it was for reasons similar^to those of other teachers: response to 
students". needs; changes in school personnel^ or organization; breakdown or 
, unavailability-of eqvipment, other reasons. As noted before, variation in 
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implementation and adaptation was a striking feature of the MACOS program in 
this study. Considering the much greater percentage of non-MACOS teachers 
reporting changes they had made or were making in their plans, the same 
condition of variation and adaptation was obviously the case for many of the 
noa-MACOS programs as well. ^ . °, * ' •- . ^ 

Linkages, Communications, and Continuities; School ContaxtB 

V • * 

Were there differences between MACOS and n6n-Mi\C0S courses in their 

4 • ' • 

r'elz -^hips to tht rest of the school program? Several aspects of interrelation-, 
ships in.v3Chools were explored through interviews with teachers. ' 

■ The great majority of teachers (76-87%) in both groups believed that the 
attitude and skills goals that they described for their social studies programs were 
being reinforced in other. parts of the school program. Teachers in self-contai.ned 
classes indicated that they tried to romforce attitude and skills goals in other 
subjectsjheyjaught. Various courses or programs mentioned by teachers (not 
just.in self-contained classes) as reinforcing the same attitudes and skills in 

I , 

varying degrees included art, reading, spelling, language arts, math, science, 
. Magic Circle, Inside- Out , physical education, and having older students work 
■ with younger students. Approximately 45% of the teachers in both grpups felt 
that other parts of the school pi*ogram were apt to cover, at least in some 
respects, the same concepts,, knowledge or other content as the social studies 
program. Descriptions of similarities of content, however, tended to be restricted 
and lacking in specificity. • . * 

There were variations from schpol to. school, or class to class, in the 
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degree and specificity of overlap of social, studies and other parts of the sdhool 

' J'.> , ■ ■ ■ 

program with respect to goals concerned with alttitudes, skills, and (especially) 

content.-. Nevertheless, 'there was sufficient indication of overlap described by 

teachers, to suggest that evaluations of particular social studies classes and 

programs need to take seriously the overall school context. 

> • Ne'arly all tetichers in both groups said, at posttf^sl., that they had 

discussed their-social studies program during the year with another teacher (or 

teachers). Predominantly, the intercommunications of teachers in both groups 

about social studies wsreVith teachers at the same gfad. .evels (fifth and sixth 

grades). There was some interaction with teachers at lower grade levels; - 

relatively fev^ teachers said they had talked about social^studies with seventh 

or eighth grade teachers, who,, for the schocils^in this study, were in separate, 

1' ■ ' . , 

■ junior high school buildings. The conclusion dpawn here is that the prevailing 

ft 

patterns of communications among teacher^ about social studies iii both groups 

were among teachers at the same grade levels. That pattern undoubtedly had 

\ ■ 

implications for the continuity and cumulative effects of social studies instruc- 

t 

tion, although it was beyond the scope^of this study to attempt to trace thera. 

Teachers' perceptions of similarities and differences of social studies 
programs in lower and higher grades to their own program were sought in post- 
test! interviews. Teachers were asked about the similarities and differences 
of their present students' program, compared to what those students had had the 

. prior two years or %vould face in the next fwo yeats in social studies. Twenty- . 

. five percent of the MACC* teachers, and 18% of the hon-MACOS teachers said • 
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they really did not know of, or could not think of, similarities with what their 

* , • . ^ i ' 

\ 

students had done in the past.' Eighteen and 11% of the teachers in the two 
respective groups did not know of, or. could, not think of, differences. Thirty- 
one percent of the MACOS teachers, and 40% of the non-MACOS teachers did 
.not know of, or could not thinlj of, similarities or differences between what 
their students were doing nowiin social studies, and what those students would 
be doing in the next two yeaTs. Hot surprisingly, sixth grade teachers were 
" more likely..to s^y th»jy did not 'know than fifth grade teachers, since the sixth 
grade students would be going to another school. In some cases, fifth grade 
teachers could not comment because they knew there was going to be a different ' 
program the following year, but it was "not yet final. 

The predominant difference in students' past programs cited by teachers 
was subject matter; the same was true also for future differences cited. -With 
respect to past tjnd future differences in programs, MACOS teachers were more 
likely than non-MACOS teachers to mention a different teaching approach or 
strategy, aher past and future similarities and differences cit^d^y teachers in 
both^oups includedsame (or different) textbook or series, siills, and focus on 
attitudes. Generally, descriptions of these tended to be broad and impressionist 

Another channel of linkage and intercommunications. ofj^oc^^ studies 
comes through principals, and social studies supervisors, or other instructional 
supervisors,' directors or resource persons. Most MACOS teachers (60*^), at 
posttest, said the pri--ipal had observed thp class at Igast once during the year; 
49% of the nor)-'iVIAC( 'achers also said their classes had been observed by the 

^ ■* » 
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principal. Less than 20% of the teachers in both groups said th^r classes had 

♦ ^^^^^^^ ^ 

been observed by anyone froTtnrmTtrat^dmliiiistrfetto The majority of teachers 

in both groups (62 and 68%) said they had talked with the principal about their 

Asocial studies program during the year. Thivty-iive percent of the MACOS 

■ ' • 

^achers, and 28% of the non-MACOS,teachers, said they had talked with at least 
drte person Trom central administration about social studies during thf year. 

At least a third of the non-MACOS teachers, and nearly halflh^^JACOS 
teachers interviewed at posttest indicated they had had spme i;eaction or comments 

abouAtheir social studies program from parents or -members of the community. 

\ . . - • t ' 

^ \ • ■ ■ « 

Most feedback, questions, or comments came during parent /teacher conferences. 

Most c6mments or reactions described by both groups were positive. Some 

MACOS leachers had questions from parents stemming from critical commentaries 

-appearing in the newspapei^s. In both groups, negative reactions were apt to 

' . . ' ■ -'.,('. 
focus dfi concern over students' knowledge (or lack of it) of American history \ 

■■> \ ■ ' 

(with the Blicentennial approaching). .. , , ; ' / 

How T6ach^rs Felt About the Adequacy of This Study ^ » 

This studywill be j'::Jtj?d by various audiences according to their interests 

and criteria. It is of interest to ask: what did' the teachers involved in it think? 

They were asked at posttest, what effects the ptudy had had 6n th^m or their . 

students, and also whether they felt we had observed (in one form or anpther) the 

significant features or important aspects of tjieir program. Some.described 

positive effects (e. g. , the students liked the-special attention; the teacher gave 

' more thought tp what he or she was Jr^ing tQido in social studjes). Some described 



negative effects (tf.g.,' the students hated the tests; the teacher found the forms 
unduly time-consuming; scheduling was time-consuming; tests and interviews 
cut into class time). , Some cited both positive an^ n^atiye' effects. S^ome 
(20-30%) aaid they'could thltifrofil) effects, posi'-'vepr negative. ^ 

^ Non-MACOS '<,«achers,-far morejthan MACOS teachers (69%, compared 

■ " ; V ■ ,* * > ' ' . 

to 43%)^ felt the s'tudyTiad picked up, in pne form, or another, the significant or 

impprtaj^t aswts of thdir program during the year. Those teachers in both 

gr9ups who felt the siudy missed significant or important aspects described them 

itx^similar terms* . The descriptions seemed principally to fall into three main 
' * ; ^ ' * * \ ? 

categories* First, some teachers felt Ave missed general classroom interactions. 

eifclting discussions, unpredictable but indicative exchanges between students o¥ 

» <■ ; 

s'latements that were made, and the like.- In effect, they felt we missed significant 

discussions and classroom interactions. Second, same teachers cited particular 
' I • ' * ., - ■ ' ' 

things done, such as cprtain project's, events, plays, international festiv;als, 

1 ■ ■ , ' ' ' ' •• 

games, class pourt or government. Finally, some teachers simply noted that we 
dldlnot really obse?ye the class-at.all. Those teachers often indicated thejj had 

r • ' ' ' \ « ' .111 

in mind observation^ and evaluations of how they conducled lessons, and hjjndled 

problems. ■ T ^ ^ . \, - . " j / 

r 'The comments' made by those teachers w^ere quite literally correct. With • 
*',•-• _.•:<•-• . 'I 

■ the pxception oi one class period, the features descijibed were not observed directly. 

- • . / ' * 

, We learned of many of the /ispects or features,they described, but from secondary 

■*'•••".•, . . ' / ' 

sources: studenfs, and the teachers ^h^mselves. It is nevertheless hpped that 

' teachers an^ others will find what fl^as.le'arned'useful, as it is summarized here 

• , ** ^ 

-and yescnibed in detail in the-fuU r%>i*i ^ ' ^ 



. • . CONCLUDING REMARKS / - 

\ ' . ■- ■ ■ ' ^ 

The^preceding summary has included interpretatlqns and 
conclusions throughout w'aerever those appeared warranted. They have been 
stated with i/eference 6o designated topics. Rather than list them a*gain» we- 
believe a few cohcliiding remarks, reflecting our own overall conclusions, 
are appropriate. • These remarks do not cover all points made or impli^ 
in ihe foregoing summary. They are Intended to encapsulate what seemed 
to us to be salient results and implications o.f the study. 

■MACOS clearly interested a large ramber and. variety of 

students. It was also clear that they learned and remembered much that , 

' ' 'I ' * ' ' 

they otherwise would not have leajrned.' The factual content of tho course^ 

i . ... . ■ • 

and 'the materi,als, were often, mentioned by students, after the course, as 

something they missed. MACOS classes were more likely Ithan I non-MA COS 

classe^'to find their ^ext year's social studies class less interesting, by 

comparison. _ , 

It was also clear that most MACOS teachers in -the study liked 
the program. Sojne had problems with it with the particul£(r classes they ' 
found themselves teaching, but the overall impression given was xery positive. 
Teachers- typically, in this studyi felt free to supplement it with other lessons 
units or programs. Indeed, variation in use of MACOS was the prevailing - 

adaptation. *' ^ 

The results of this study, however, suggest that the course was 
more effective with older students (in this case, witl^ sixth graders, compared 

^2 ' ' ' 



fo, fifth graders). The overall results also seemed more modest than the 

fleaigners. might have- hoped. The course has br.oad goals that of course^ 

are difficult to define and measure precisely. By the methods employed ' 
- - . , ' " i 

in 'this study, we found no systematici advantage of MACOS, compared to • ' 
■ V - • • . ■ ■ . 

• the nbn-MACOS group -of classes, in phe development of inquiry sjcills, in 

the development of interest in open-ended problems, (a tolferance for am- 
biguity); in interest in problem-solving, or in ind^ased confidence in 
ability to solve problems.%' All of these may have occurred with individuals. 
We failed to find evidence of them in the "group of classes as a whole. 

■ MACOS classes, on the average, did tend to stimulate significantly more 
"positive reactions than non-MACOS classes, on the average, to unusual, hypothetical 
■ customs, beliefs or behavior, though not towards people or groups that might have ^ 
such customs, beliefs -ox behavior. If responses to questions on a pencil and paper 
instrument are at all indicative of Social attitudes^ M '^OS, as implemented in the 

V ■ 

class es.in.this study did seem to have a positive, bttt'^temporary, effect. More 

5> • ■ ' ■■ ■ 

positive attitudes were associated with greater amounts of implementation of the ^ 

curriculum. 

5 

* f * * 

MACOS did seem to support a form of pedagogy consistent with 
^ the deslgnersL inteations. It did go more effectively, on the average, with. , 
older, more. affluent claisses (that is, classes with lower percen}ages of 
low-income children).' ,We -found it interesting, however, that overall,* the 
outcomes of MACOS clissses, particularly atHtude outcomes^at the end of the 



course and subsequently, the following year, were less sensitive or related to 
how students viewed the cours'e and how it was implement^ed than in the 



non-MACOS classes. With respect to attitudes particularly, but also achieve- 



ment, MACOS appeared to provide more leeway for a range of teacher attitudes 

; - j \ - . ' 

and teaching strategies than the non-MACOS groiu) of courses, ta\cen as a 

1 ' \ ' ^ ' \, 

s _ \ / - - * \ ' 

whole. ButMn both groups, the data of this study suggested that v\ariations 

iff the attitudes of teachers, and in classroom emphases and activities had a 

greater impact on atUlmles of students than on achievement. In this context, 

it was of interested note in the MACOS group of classes that when achievement 

and attitude outcomes were considered together, it was attitudes more than 

aohievemenrt|iat were affected by increasing amounts of implementatietf. ' 

. A final comment concerns reactions of students to vivid or i ^ 

" disturbing material" issues or other content. 'Both NIACOS and » non-MACOS 

.grouffs.of classes fead about, siw* and discussed .topics or situations that 

were vivfd and which evoked strong ''reactiohs .in studenfs, more so in fifth 

'Tthan sjxth graders. It appeared from the da|a of this study tljat what was 
' ' ■' - ' '. . . K ' 

particularly likely to evoke strong reactions, was whatever appeared to be 

cruel, exploitative or unfair. Students could understand unusual cust'oms or | 
; ^ • ■ i 

preferences, and even see reasons for them. MACOS students were apt to \ 

' react strongly, at least at first, to the Netsiliks' eating preferences and ^ 

' habits. But it was their treatment of animals, and the way animals were 

'killed, that students were likely to disapprove.- Social studies, perhaps" 

more than other subject areas, may tap important issues and evoke strong 

reactions, at least temporarily/ That happened in both groups of classes 



in this study, 

> 
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L PURPOSE AND BACKGROUND OF THIS STUDY''' 



A, Purpose 

The study reported here is an ^^nquiry into the uses and results of 
Man; A Course of Study (hereafter called MACOS or sometimes jusf M), a 

3 

one year social studies program originally designed for application at the upper 
elementary level. The study is. restricted to 5th and 6th grade (or equivalent 
non-graded) classes in fmblic schools. 

In most general terms, the study is an^nVestigatioji of three questions: 

1. What do students who take.5i^AC0S learn? * \^ 

2. ViTiat .do they retain? 

3 Is what MACOS students learn different from what non-MACOS 
students leara? 

^ These broad questions were, of course, narrowed with respect to 

• « 

variables and time periods. Nevertheless, the appro5jch of the study has, 
constantly been tojry to obtain as broad a'scope as possible and feasible. 

The essential method has been comparative. Classes of students at 
the same grade levels, which were in the same school districts and which 
were in social studies programs other than MAC OS, have served as the com- 
parison. This group of classes will hereafter be called non-MACOS{ or sometimes 
simply NM). The group is a coageries of programs including Holt.Data B<ink; 



\ 



1. Thi^s ^^28"^ ^04 ^^"^^^''^^ under National Science Foundation Grant No. SED 

2. Published by Curriculum Development Associates, Inc. , Washington D.C. 

20036. MACOS was developed by the Education Development Center, 
Cambridge, Mass., 02138, principally under grants from the National 
Science Poundatio;!. 
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Harcourt, Brace, Joyanovich; Allyn and Bacon; Silver Burdett; et. al, as well 
as occasional teacher-made programs^. 

The comparative method has a decisive operational meaning in 
this study: all forms, questions and procedures applied to MACOS classes 
were applied equally to non-MAfJOS ones. The method has important strengths, 
hut also inherent constraints and limitations.- 

WTiile the essential aims of the study have not changed over the three, 
years of its conduct, thg conceptualization of it has undergone modification and, 
it is thought,cldrif{cation.^ The project has alw.ays been concerned about the 
fidelity of a course, the correspondence between the intentions of the designer 
and the practice of the implementer. The actors and forces impinging on the 
classVoom- students, teachers, parents, administrators, norms, 6xpecfeations» 
sclicdules, etc\, - exert powerful influences on that corrr-pondence, at least 
.in the^ social studies. Tlie study is thus in part an inquiry into the question: i^ 
one is going to teach MACOS, what are some of the things one ihay expect under 
various conditions^ And how do they compare to \vhat might be done otherwise? 
As a corrollary» the study has attempted by three different metnods to determine 
what seems to have been done in classrooms^ to obtain, information about the con- 
tent^and methods of implementatiorji. Thus the study has scjght, within the IrmitsL^ 
of. resources, to examine to the extent possible, processes as well as outcomes. / 

The aims of the study have been to'delinfeate sliailarities and dif/crences.i 
As described in the Section II, it involved following over a hundred classes during 
the academic year 1974-75, and then doing two follow-ups vvith samples of s.tudcpts 



from each class in October and May of the 1975-76 academic year, ^^hilet^ ^ 
ostensible focus has been on MAC OS, this study has to keep in mind and Spiore* * 
larger issues pertinent to upper .elementary social studies. 

♦ a 
♦ • 

B. Background , 

.. During the development of MACOS, an extensive formative evaluation 
was dpne by Hanley. et. al.. as part of the development .process.^ This study ^ 
used teachers and classes participating in field tests of the curriculum. Hanley's 
study essentially involved measures and observations of MAbOS studept^and 
classes in different types of school districts. Some non-MACOS comparison 
'classes were'observecl. and comparisons were maBe ofetests of children in MACOS 
and non-MACOS classes. The study was primarily absolute in form, how'ever. . 
It concentrated on gains made and interview Information provided by students and - 
teachers in the'pilot MACOS classes. 

Subsequent to Hanley-s study, and at the'time the curriculum was being 
^ prepared fo'r commercial distrfbution, a small field investigation was conducted 
' by Cort .4 The pur^ose was-to investigate alternative approaches to further evalua- 
tion of MACOS by examining the conditions of utilization of the curriculum in 
selec-ted schools and districts served by EDC^upported Regional Centers. Sbme 

r^ilTet p. Hanley. Dean K. Whitla. Eunice W. Moo and Arlene s! Walter 

r"l.i^ y/CoIetenc o/rinn,n.unitv: An Evaluation of Mnn-A Course of , 
Study, s'ocial Studies Curriculum Program, Educational Development 
Cliiter.. Cambridge, Mass.. 02138. Vols. land II. 1970. 

' 4. Cort. H. Russel.' Jr! . Nqomi.H. Henderson and Cheryl Jones Approaches 
to Further F.valuation of Man: A Course of Study. E^iucation Studies 
. Department, -rhe Washington School ot Psycmatry, Washington. D.C.. 
■ ' 20009, 1971. tader N&F Grants. V/005707. , 



of the tentative findings of that study were that: » different teachers^ hatTdifferent 
goals for the course; 2) many teachers tUought they could teach the same skills' 
and attitudes with other materials; 3) many teachers saw content primarily as a 
vehicle for stimulating inquiry processes and felt that process was the important . ' 
element; 4) many teachers felt puzzled about how to evaluate results', or at least 
how to communicate their assessments of progress; 5) the course may not be 
appropriate for all teachers, or for all students; 6) the primary criterion of 
effectiveness in teachferi' v.ews wa sjlie exte nt to which students became interested" 
and involved; and 7) the main criterion of failure of the course, in teachers' views, 

was if it were taught in a traditional,* didactic, lecture fashion, with emphasis 

' , .«s 

on facts. The study also expressed concern that the teachers involved in MACOS 

• . , ' - • . -. • . ^ - 

theretofore, were carefully selected, or self-selected, and were not necessarily* 

typical of the broad upper elementary spectrum. The principal conclusion of the 
study was that any further evaluation of MACOS should.by systematically compara- 
tive, and should be longitudinal, extending beyond the durxation of the course. 

The curriculum hqd attracted much attontibn almost from its inception 
as one of the more elaborate of the federally funded social studies curriciilum 
projects of the 1960's. It provided an opportunity, eventually, for Jerome Bruner 
to guide theVa.islation of pedagogical theory itito curriculum design. It marked 
a dramatic entry ef the beha'. ioral and sooial sciences into the social studies 
area at the elementary level. It also early on provoked opposition from various 
individuals and groups concerned with issues of evolution, sex educati.6n, dis- 

"^5: Fift/ one teachers, 16 principals, 15 administi-ators or.curriculum 

directors in 24 school districts were interviewed, as well as 6 MACOS 
Regional Center Directors. Some but not all classes were observed. , 



placement of American history from the 5th grade curriculum, and invasion 
of privacy.* Such opposition has continued, as will be noted below. 

\ 

MACOS was -reviewed by Sanders And Tanck in Social Education in 
. ' ■ ' . \ .■ • ■ ' 

1970.^ Bumstead reported critical impressions of^it in Educate. It was 

analyzed for the Social Science Education Consortium by applicati^nof the 

Consohium's Curriculum Materials Analysis System. Jones devoted attention 

to analysis of it in his book. Fantasy and Feeling in Education. " The Eastern 

" . • - . ' \ 

Regional Institute for Education (ERIE), in Syracuse, New York did a number 

- \ 

of studies aimed at identifying factors affecting the dissemination and effective ' 
installation of process currircula, including MACOS. Deffenbaugh, et. al. , in- 
vestigated instruments for measuring teacher attitudes and behaviors.^, Calvert 
reported improvements in students' attitudes toward social studies when MACOS 
was introduced.^^ By 1974-, Eisner and Vallance us^ed MACOS as ,a test case 
for application of their concepts of fivepurriculum orie«tations.ll And also by - 
1974, Socia l Edugatio n devoted a special section to MACOS, including an annotated 

' 6. Sanders, Norris M. , and Tiinck, Marlin L. , A Critical appraisal 
of twenty-six national social studies projects. Social Education, 
Yol.' 34, No. 4, April, 1970. See also an evaluation in Social Educa- 
tion, Vol. 36, Noi 7, Nove^erl972, pgs". 742-744. 

• 7. Bumstead, Richard A., Man: a' Course of Study, Educate, Vol.3 
No. 4, September 1970, pgs\ 20-29. 

8. Richard 'M. Jones, Fantasy apd Feeling in Education. New York: 
" ■ Harpe^- and Row, Inc. ,.1970. \ > - ■ , ' • ' 

*■ 9. ' Deffenbaugh, Sue A. , et. al-i , Aninvestigation of an Instrument Battery • 
Relat6d to the Expectancies for Stud cnt-C entered Teaching Behavior . 
in Man: A Course of Study. Final Report .^ ERIE. July; 1970. 

10., Calvert, John F. Change in Student Perceptions of the "Social Studies" 
' Following the Introduction of M>\COS . ERIS;^ November 1, 1970. 
■ 11. Eisner, Elliot W. , "and Vallance, Elizabeth, (Eds.), Conflicting Con- 
ceptions of Curriculum . B^kley: McCutchan, 1974. ^ 
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bibllpgrsphy.-'-^ The curriculum also provided opportunities for graduate re^ 
search and doctoral dissertations* Youngers, for example, studied types of 
questions asked in samples of MACQS ancl non-MACOS classe3.^^ An ERIC 
search conducted in 1976 revealed several other subsequent MACOS studies. 

There have of course been other social studies curriculum develop- 
ment of major proportions currently with MACOS, and there have been forma- ' 
tive evaluations on the scope approaching that of the Education Development 
^Center. An early instance Vf the latter was the study of the Taba curriculum 
for grades 1-8.^^ MACOS, however, has ^^jontinued to generate more general 
interest and controversy than other purricu^, altl&ough that^generalization 
does riot always hold in4)articular locations and time peviods. 

In .the late spring of 1972, .Antioch College was given a grant by the 
Naf tonal Science Foundation to plan :t longitudinal study of MACOS. This eventu- 

• - c ' 

V ' ated in a proposal for a four year study o( MACOS and non-MACOS classes, 
/ that involved repeated stiidy of the^same MACOS and non-MACOS teachers over 
a two yenv period, and ftollow-upVith samples of students., also over a two year 

period. , - ^ ' . - ^ 

The study proposed gUbw out of a three day design conference held at 
♦ .* , f 

the beginning of the planning project. A group of ten consulta-nts^ 60me of whom 



\ 12. Socia] Education, Vol.*.38r-No..5, May, 1974. pge. 441-457. 
* ^13. youngera,*John C. A Descriptive Study of the (?og-nitive Emphases 
^ Expressed in Man: A Course of Study Social Studies Classes. Doc- 
toral Dissertation-, -the University of Rochester, New York. 1972. 
Also,"* Arends, Richard J. , A Summativ^ Evaluation of Man: A Course 
of Study: A Study of its Human Effects. ' Doctoral Dissertation, Uni- 
versity of Oregon, December, 19'72^ 
14. -Wallen, ' Normaq E. , et. al. , Development of a Comprehensive -r 
Curriculum Model for Social 'Studies for Grades One Through » 
. * Eight Inclusive of procedures for lirpJem'entaticn and Dissemination. 

ERIC ... ^ 90, • 



were specialists in socidl studies curriculum and teaching, others with evalua- 
' tioa and measurement expertise, met with project staff to thrash out issues, 
purposes, l>bjectiws.and methods. There were strong conflicting views 
^pressed and debated. Questions were raised over whether one should even, 
expect any effects of a single course over several years; over whether measured ^ 

learning outcomes should even be tha focus (characteristics of classroom acti^ 

* ' ' " ' ' • ' 

vities were considered more crucial); over what the real goals of MACOS 
VereVhorhow they could^be^oper^LtJonaHzed for purposes of measurement; over ^- 
what information'would be of use to whom; over whether or not to impose a set 
• '*^of standards .(for outcomes, for teaching processes) and measure MAGOS against 
' ' those standards; over the role of parents and how to include them in the study; 
over what constitutc^s a'n impact on and change in. the education process and sys- 
. * • ^ .tern, and so on. A beginnir^g was made at clefining prpcess and outcome variables, 
- and recommendations were.made for particular instruments and procedures. 

The resultant proposed design was a compromise, of ;iecesslty. It 
" , was. an attempt lo strike a Valance between conflicting positions and purpdlsos. 

I N|^In some cases, strong recommejjdations were rejected. , For.example, the- 

1 - ^ 
' recommendation to include^as part of the proje^ct a genuine exp*erim*ent, with ^ 

random, assignment of teachefs to curricula , .was i^ltimately rejected as un- 

feasible yn a large^enough scale. 

The proposed study was submitted to ^he N&f in the late fall of 1972. ^ 

.... ■ ' * ' \ 

Funding problems arose nhd the project lay dormant for over a year. The ^ 

* A > *. * fir ■ 

■ , San Francisco State College, Final Report , Project No*. 5-1314, Grant 

No. •OE-6-10-182, October, 1969 (ERIC ED-040-106). 

" i» 
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NSF did have the proposal reviewed and made reviewers criticisms known to ^ 

the project co-directors. In the Fall o\ 1973, the NSF requested a revised^. 

* * ^ ^ <j 'J- 

* 15 
plan, scale down to fit specifU>d budgetary limitations. This revised plan, 

, which will be described in Section Ii; was funded in December, 1973 and 



starrted in Junuary, 1974. Further modifid^tions va design were made as 
the study proceeded (as will also be described). 

Subsequent to the start of this studjs MACOS continued.fco |)e embroil- 
ed in controversy. Weber wrot^ a critical commentary on MACOS in the Phi 
Delta Kapfpan o f Odtober 1975, with response from Peter Dow, Senior Associate 
of the Social Stttdies Program, Education Development^Center/ That,.same^ _ 
month, Dow also had an article in Social Education paired with one by Congress- 
man John B- Qonlon that summarized t Congressman's reasons for opposing , 

c 

f ■■ , * . , 

* 9 ^ 

the curriculum and hfs concerns about the national development, marketing 
and dissemination with , use qjf fax dollars. 

Earlifer in the spring of 1975, MACOS had become a central stimulus 
in a debate in Congress over NSF funding that resulted. in a termination of * 
fiirther implementation grants for MACOS by the NSF^ James 

V 

had several nationally syndicated'columns on MACOS.-'-^ Various new.spapers 
and magazines reported on the debate in Congress. The Chronicle of Higher 
Education,, and the APA Monftor of the American Psychological Association 



15. In subniitting the larger proposals, several options for reducing the 
t sc'ope'of the project had been suggested. ^ ■ 

16. George Weber, The Case Against Man: A Course of /study. IPhi Delta 

Kappan. October 1975. Also Peter B. Dow, MACOS: The Study of 
Human Behavior as One Road to Survival. 

17. The WashingtonlSta'r rMarch 1, and Mtirch 24, 1975; also January 20, 1976. 
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ratt articles oa the controversy. The General Accounting Office did an 

ittveatigatlon of. MAC OS *hnd NSF administration of the program. The NSF 

cottducted a high*^ level; internal staff review of the curriculum, a'hd Con- 

gress'Jiad a panel investigate it. The National Council for the Social Studies* 

published a position statement on MA<X)S and the broader, issues of the federal 

tole ia curriculum development and implementation. The MAC OS contro- 

versies w.ere considered by the Curriculum Development Task Force of the 

. National Ihstitute of Education. 

These doniro^ersies over MACQS, which centered around the appro- , 
* <» 
priateness of its content fo^ 10-12 year olds, teaching sympathy for lurid and 

^^orycu'sloms^, netting up sev^T*ejnoral^dii^ in students and reducing oi 



alienating-their belief in the values of their parents and their communities, 

* » < ' 

promoting and marketing a curriculum with taxpayers money, and unfair com- 

petition with private publishers, stilL continue although with less play in news 

media, .puriag the course of this study tiiere have been attempts to test hypo- 

theses based qn th^sb educrational concerns and apprehensions. 1ft effect, the 

study has also attempted to investigate questions arising over the effects of 



MAC OS content on students. / * - •""'^ ' ^ 

t . , ' • ^ - , ^ « ' 

* 18. Philip M. Boffey, /'Social Science Curriculum Under Fire in Congress," 
The Chronicle of Higher Education, March 31, 1975; Karen Schaar, 
MACOS" Assailed: Congress Debates Curriculum,'* and ''MACOSt the , 
Controversy C-ontinue3,|" APA Monitor, c Vol. G, Nos* 6 and 7, June ' 
• ' 'and July, 1975.. ^ ' ■ ' , ' 

19, Th e MAG OS Question; Vjews of "Matti A Course of Study" and the ,* 
Roles of 'the National Science Foun<jation and the Federal Government 
in Curriculum Development and Implementation. A Statement of the 

' i ' National Council for the Social Studies, June 20, 1975. 

20, - Current Issues, i^r^blenis and Concerns in Curr^iculum Development. 

* A Report and Set of Recommendations Submitted to the National Council 
* * on Educational Research in Responding to NCER Resolution 093875-19-3 
THe-NIECurrfculum^Development. Task Force, NIE, Janual:y,,15, 197TJ. 



IL DESIGN OF THE SfUDY 
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A. Initial Design of the Study , ^ * \ ' • ^ 

^ 1. Sample design goals y | ^ - * 

/ An underlying assumption of this 'study has been that the classroom^ ^ 

was the primary unit of analysis, and the design was therefore based on classes, 

' ' ' .' \' . . . 1/ ' 

not students. *It is a stringent but reasonable assumption, made to afford the ' 

necessary independence of units by eliminating the correction of 'scares witHiri 

a class. The initial goal was to ha'ye 72 MACOS and 72 rion-M^COS classes, dis»- . - 



tributeij equally in 6 districts within each of 4 major geographical regions. With- 
in ertch region, the aim was to have 2 districts of each Of three types:, urban, ' , 

' suburban, riiraL^ * , • * . . , / " 

For reasons of e.ost tmditidministratlve feaglbj^ty as well as research. f 
design, there were'cri'taria for inclusion orle\dbLLsion of cllis^esjpjhe^ti^^ / ^ 

' , , MACOS was originally designed as a program* for uppfer elementary . ' 

students (grade 5 and 6).^ \For that reason *it w^s decided to ^ 
restrict the study to classes at those grade levels. x " * * - 

) ^ . . ' \ : . ' . ^ r 

^ : • The question of what would ppn^itute an appropriatcTgroup " t-^ 

of comparison (non-MACOS) classes had beeh.considered ej^ . . /. 

tensyvely. X number of alternative possibilities had be'dffco.n--^ . 

/ sidereS. ;It was beUdvJpd 'that ^t^ie mbst^meaningful property ;/ 

comparison group of clap.s,es in a non-experimental study was' 

^ related to tlie q :estion: <vhSf do MACOS students do ^nd learji in , , ^ ^ 

social studies compared to what they othcrwise,wouia ftave done , . , ' / 

and learned? It was further belfqved thnt the.closest npproxi- . , / 



9 



./ 



1. The'fneasure of,this sociological variable employed was the U^S. Office' 
of Education';? Metropolitan Status^ od6,. a- S-levet classification con- 
sisting of Metropolitan, Central (l)^ Metropolitan, Other'(?): and Noh- 
• Metropolitan (3). Tor definltiot^s, see vStatistics of Local P ublfc- School 
' Systems, FinancyfeM972-73' Natiooal Ce*&r for Educational Statistio.5 
NCES 76-156, U.'s/o. E. , D. H. E. W., Washington,* D,,C. , 1976.. pgs. ;a-3. 
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mation to that, holding as, many ^ucational and copimunity back- 
ground variables ^constant as possible, was to'obtaln non-MACOS 
clasBes in the same school districts from whidi MAC OS classes 
were dVawn. ,The stibool^district is the administrative and po- 
licy making unit of schools 'within it, and it is the focal point of 
of , overall community, iijtei^ests and influences on local education. 
It w^s therefore decided to restrict comparison c^lasses to schools 
\yithinthe^3ame districts as the MACOS classes if possible. 
'That deciStOn led to the jrequirement.that a district wpuld not 
be included if there <vere^no schools with alternative 5th or 6th 
graiJe'sotfial studies programs an the district. However, pend- 
ing the results of a survey of ciiJ^ricts, it wns^deciaed that if 
the 'requirement could 'not be*me^a fallback positio^i would be 
to match-MACOS and/1ft«^iyL4X:Q^ist^ on demogY'aphic cri- 
teria and io draw coiHparison classes from alternatii):e districts. 
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. It was decided that since public schools were the major market 
for (and ai;ea of concern of the community about) MAC(pS» only'' 
public school classes would be included in the' study. 

.Situation^ ip^'v^h MACOS vvas'to be taught ovfer more than one 
i academic y^ar (e..g. ♦ the Marfjptl j^ther Animals section in the spr 
the Nefsjiik sectipn the Jollpwing fall) were excluded in C|rder to 
retain as much \36mparabHity ofMmplemcntation of MACOS *is 
possiblei , f^* ' • * 1 ' . 

\ Another " 

MACOS 
^ MACOS 

that app 

any paji 
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cTiterton m^suUed^from the question of whether ric 
cjassej^sh^ld be drawn- "fram th6 same schoolsjij9-JLhe__^ 
classes. ^ There were Valid conceptual reasons for taking 
roach' if'iUwi'Vhogonal design could be carried out.. For 
_ Df clashes C^IACOSi non-MACOS). it would minimize the 
extraneous effects pf variations between schools and school en- ' 
rollnielil areas. To not do so would eliniina^ the possibjlity of 
analysjiig^difolitly effects of^ on MACOS related to scljiool 
characti?risti4?.% Thpre'were. howeyer, countervailing conside- 
ratiQtts? 'ifM^as considered- (ksirable to avoid the implicption of 
a compctiticin j^etwe;en MACOS and other s.09ial studies programs 
within a buijliaih6;-/Al\ was afeo believed that It would be u^ide.^ir- 
able to liave to eUminate schools where onPy one S^h ot (jth grade ' 
could \)i obtained. Furthermore/ |t)vas believed thaj participa- 
t'ion^y 1 eachers Axftl^ study-.shouUrbe .voluntary. and thaj it would 
be un^Orable to restrTcf. the design only to cases in wh^ch there 
were at lSi|l two teachers* *MAC0^.ahd hon-MACOSjin the same 
building wfio were^ilU-^g jto'parMcipale. On tecjinical.grounds, 
if an orl fiogonnl design within schoojs could not tie maintained ^ 
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/ uniformly, then it wal desirabre to maintain independence of 

classes to the extent possible. It was therefore'decided to 
draw non-MACOS c' ^sses from different schools than the MACOS 
classes if possible. That decision Bei;force eliminated districts 
with just one elementary school, although il did not eventually 
result in just one class per building,' \ ^ 

V ' ' «... r'^-^^ 

» ' ( • 

.Classes in districts requiring travel beyond the boundaries of 
the contiiieatal United States (e.g. , Alaska, Hawaii, Puerto 
RiXio, Virgin Islands," •American Samoa) were excluded to mini- 
mize travel cosis.^ ^ ' \ 

Sampling was not intended to he repres'^ntative of public schools districts 

of the United States because MACOS w;\s not, m 1972 and 1973, distributed rando^ily- 



Predominant utilization in 1972 was In districts ranging in ^ize froni 1, pOO-24, QOO 
students, ijtmzt^tion also was not proportionateFy distributed in states Within 



t 



regions or atopng regions. U was used predominantly in districts in the North 
Atlantic and Western states. ^ , , 




2. ^ Obtaining disfriets and classes 

In.Fcbniary, 1$)74, a brief questionnaire was s^nt lo.all pJliblic .^chool ^ 
superintendents, along with a short summary of the intended project (see Appen- 
di x J ) . A return adcire^cd pre-pntd envelope was ipcluded. Th^ questionnaire 

ntiiilly asked: * ^ 

I ' • ' - 

. wjiether M/ OS jvas to be used as the primary social studies 
curr^iculum grades 5 and/or 6 »n the 1974*75 academic y^ar; J 

, in l/ow many schools, by how many,leanhe.rs;fapproxiiTlate 
pe/c,entage of classes at 5fh, 6th and 5/6 levpls; 

/ i / ' , X . 

. whether the disjtriol was interested in consider]^ particioation 
in the proposed study; * , \ 



2. Thoso tire regional dlassifications used by Ihc L'. S. Office of Education. 

' 7 ^ ' . / 



.some, characteristics of classes at the upper elementary level 
—(s^lf-contained, departmentalized, etc.); • . 

' • . sdme demographic characteristics of the district. ^ 

The questionnaire w.ent to approximately 16, 500 superintendents: 

J^eturn rate was 12% which appears low. However, over 25% of the districts ^ 

then using MACOS^t the 5th or 6th grade level responded. Responding districts 

.were sorted into districts that intended to use MACOS at 5th or 6th grade:and 
were willing to consider participation (102 districts) and/6istricts that were not ^ 
agoing to use il bat were Willing to consider, participating (607 districts). The 
jjistricts in both groups were classified according to 'Metropolitan Status Code, 
based on U.S. O. E. lists. Concurreintly, 419 districts inwhigh MACOS was 
•being used at any grade level obtained from a list provided by the publisher. 

^Curriculum Development Associates (CDA)c> w^e similarly classified. 

The list of responding and irjterested MACOS^districts paralleled the 

^ ' . • ' _ ■^^^ 

list of CDA sales districts onbbth'characteristics and'diverged from the 
responding, interested non-MAC OS districts on both variables, as shown in 

vTaole n-1. T^Qhle II-l: Percentage .Distributions of Districts 

a. Classification by U.S. O. E.jRegions ' - 

North Great , South * 

Atlantic Lakes , East ' West - Total N 

1. MACOS ' '37., 3% 18.6% t 10. 8% 33:3% , 100% 102 ' 

2. CDA List ' 47.-3 1-8.1 8.8 .25.8 100 , 419 

3. Non-MACQS. 24.9 44.5... 9.6 21.1 . 100,1 607 " 

b. Classification by Metropolitan Status "Code 

Metropolitan , Metropolitan Non- 

C entral Other Metropolitan "- Total N 

1. -MACOS ■ 11.8% ' - 52.9% 53.3% 100% 102 

2. CDA List i3.4 f)4. 7 • 32.0 100.1 °419 

3. Non-MACOS' 10.1 ' * 28.7 61.3 100.1 607 

^Numbers may noJ add to 100% due to rounding errors. 



II-4 



Districts in the MACOS group were then screened according to criteria 

described above, with a resultant 57 districts meeting them. From that pool, 

27 districts filled the region-brwetropolitan-status matrix, and also met the 

following criteria, based on KC£ected^use 'of MACOS: 

.at least one school at 5th' grade lev^l and at least one school at 
6th grade level, or 

.2 or more schools ^with non-graded 5-6th grade classes, or 

.5-6th non-graded classes in one school with af least 2 or more 
teachers* " 

Based on these results, it was believed that adherence to the plan of 
obtaining comparison classes within the same districts was feasible. However, 
attrition was expected, a" replacement plan was to draw on a random, basis from 
remaining districts matched by region and metropolitan status code or.by metro- 
politan status code if there were no remaining districts in the region. 

Districts were contacted, starting with the 27 that filled the region by 
metropolitan status design.'^ This process started in late April, 1974. "it was 
the start .of a series of negotiations, delays, defaults and false starts that in 
fact lasted'until a week before*pre-testirig was scheduled. A number of districts 
' dropped out when tlie social studies coordinator or other person designated by 
the.school as the contact for the study formally sought approval from the Super- 
intenaent, the Research 'Review Committee orclther formal authorizing body. 
Sorae^ere dropped when, upon talking with the coordinator, i|was discovered 

♦ 

that MACOS.wafe to be taught in two half yeai>i)arts, .one in 1974-75, the other 
-'the following-year. In a few cases districts declined to participate when they 



found the project was not going to provide them with MACOS sets, or .teacher 
tfaiRingfOr both. In a few big city cases the district dec^Jined finally because 
of cone fern about the additional testing burden on students already subject to 
much testing required by federal programs s^i5h as ESEA Title I By the 
opening of schools, the project had firm, written commitments from 16 dis- 

, . ' ' 4 ' 

tricts, one of which dropped out a/ter pre-testing, giving 15 districts. 

Although^e original aim had been to obtain classes in 24 districts 
meeting geographical and demographic requirements, the number of 
most concern was the number of cl'asses. A minimum feasible level of 50 MACOS 
and 50 non-MACOS classes had been set. The rationale underlying those sample 

sizes was that a minimum measure of the comparative effect of MACOS would 

* - .... ^ 

be a^covariance analysis of a dependent v-ariable, with group (MACOS, non- 
MACOS) as the independent variable, and pre-test, class size, -a measure of 
socio-economic status, and a measure of.age or grade level as the covariates. It, 

was considered that the power of such a t^sl should be at least . 7. It waS also ' ^ 
thought that an effect size of . 25 was realistic. In Cohen's suggested guidelines, 
that is a medium effect size for a simple analysis of variance, and is comparalfle 
to about 6% of the total variance of the combined groups accounted for by group 
membership.*^ Assuming a significance level of . 05, sample ^oizes of 50 classes 
in each group would be necfessary to meet those requirements. Such a con- 
ceptualization assumes that samples are drawn or assigned on a random basis,. 

3. Cohen, Jacob, Statistical Power Analysis for the Behavioral Sciences . 
Nev; York: Acddemic Press, 1969. See Ch^. 8, F tests on means in ' 
' the Analysis of Variance and Covariance. " 
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and that they are statistically independent. It was believed, however, that it wasr. 
a deffetislble basis for setting minimal sampje requirements for proceding 
dwith the study cn the following grounds. The ultimate aim of the, study was 
to observe MAC OS classes, and non-MACOS classes^ in a variety .of contexts, 
geographically, educationally, and demographically. Although the dist:l*ict was 
considered pn important administrative social and educational unit (and was 
certainly^the necessary point H)f access to schools and classes), it was believecj 

• that the classroom w.as the critical locus of instructional effects*. 

The issue of independence of units obviously extends to the school 
building* If classes nested in districts may be correlated, classes ne§ted in 
schools also have to be considered correlated. It would heve been optimal either 
to have had 2 or more MACOS classes per school building and two dr ^nore non- 
MACOS classes per building, or only one class of either kind in any one build- , ^ 
ing. Either requirement would ^lavis forced the exclusion ofsituations (speci- 
fically, districts) that, it was believed, provided a variety of different settings 
"-.ior the iniplementation of MACOS-, Effort was made to obtain MACOS and non- 
MAGOS classes in separate buildings to the maximum extent possible. HoW- 
ever, considerations of different conditions of implementation,\as well as 
feasibility and cost, were also of im portance^ Thus the ult imate criteria ad- ^ ' 

• here^to were that: ^ ' , } ' . 

.the MACOS and non-MACOS classes must be at the 5th or 6th, 
-grade level/o^ a non^aded equiv?*alent; , 

^ .ther6 should be a minimum '^pf 2 MACOS .and 2 n^bn-MACOS 

classes pei; district; ^ 
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.ther6 must be at least 50 MAG OS and 50 non-'MAGOS classes; 

. MAC OS was intended to be the primary social studies curriculum; 

/MAG OS was not originally intended»to be distributed in imple- ^ 
mentation across 2 school years** 

Realities of ^e situation, then, forced changes in therdesignT-although ~- 
not in the ultimate focus of the study. The factorial design crossing geographic 
regioD with. metropolitan status was abandonned. The design was not orthogonal 
with respect to schools within districts or classes within schools. There was a 
smaller number of districts 'and classes- than originally planned. However, other 
change's were made*?n the measurement and observation design to strengthen 
the information oht&ined, particularly through increased interviews with students 
/knd teachers. Subsequently, main analyses treated the study as a two-group 
(MAGOJ, lbn-MACOSi;„ pre-post and fpUow-up design, with classes as the unit 
of analysis. Attention was also^paid to possible district.and school effects and 
their implications. ^ . ' , ' " - ' 

The resultant samples were 57 MAC OS and 51 non-MAGOS classes'dis- 
tributed in 76 elementary schools, in 15 districts in 11 states (Florida, Virginia, 
New Jersey, Pennsylvania,' Illinois, Iowa, -Nebraska, Colorado, California,' 
Oregon, arid Washington). The resultant sample of 15 districts differed in re- 
gional dfstribution in 2 dategories from thfe CDA list, but, more importantly, 
retained the MeU^opolitan Status distributions of MAGOS utilization noted in 
Table The 15 distri6ts were dis^^ ^ , 



' - Regions 

North Atlantic 13'. 3% (47. 3)* 



Great Lakes 
Southeast 
West ' , 



40.4 (18.1) 
23.3 (8.8) 
33.3 (25.8) 



Metropolitan Status 
Metropolitan Central 

Metropolitaa, Other 

, "if" 

Non-Metropolitan. 



13.3% (13.4) 
53.3^(54.7) 
33.3 (32.0) 



' *Numbers in parentheses are the percentages of districts that had 

bought MACOS sets, according to lists obtained from the publishers \ 
in 1972 (see Table II-l) 

• In effect, the classes in the study came from a distribution of districts 

that was similar in metropolitan status to that in which MACOS was being . 

bought, -since one might wish to generalize to groups that seamed likely to try 

MACbs; that similarity of distributions wa^ considered particularly important.' 

■ • ■ " ■' • . 

More detailed descriptive information of the c ha ra6t eristics of districts, schools, 

^jlasses .and teachers Is given in Section IIIB and in Appendi x B . , * 
3. Selection of Schools and Classes • ^ 

in most cases, there was little or no choic)?*in schools and teachers 
for selection'of MACOS classes. The main choice was in non-MACOS schools . 
and classes,- and in some districts there was no choice with resp'ect to^schools 
because ther§ were only two alternative^schools. In negotiating with district 

coordinators, a form was provided on which the-following data for elementary 
« . "■ ■ • ■ . ' > ' • ^ 

schools were requested on a school by school basis f ^ 

. number of MACOS and non-MACOS teachers at 5th, ^th and 5-6 
■ non-graded levels ... • ' <> . 

. average reading achievement scores for 3rd and-6th grade levels -„ 
.•percentage of students eligible for free lunch program 
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, . percentage of minority: stu(Jents , " * 
* . ' , , ^ '.percentage of bi-lingual students ^ 

In cases in which thc^se data were made available prior to the start of 
school in September, 1974, and in which there was a choice, comparison classes * 
(schools) were picked frdm^ those that most'tJloSely matched MACOS. classes 
(schools) with respect to reMing'achievement and socio-economic characteristics 
(using percentages of students eligible for free Lunch as a measiu?e)« -In cai^es ' 
in vvhich the district coordinator picked comparison schools (the gr^B^t majority, 
•of cases) they were matched,t5rpicallyfOn the basis of student plpulation charac- 
teristics /socio-economic and racliil composition)* _ In one case the comparison 

. , A . ■ . \ ■ . . ,■„ 

was oicked because it was the only other school in the district matching on the 
basis of organization of the school.' - 

Teachers were selected either by the district coordinator or by /.he 
school principal ^ Participation was intended to be vojuntary^although it even- 
tually became clear (in interviews with teachers) that some teachers felt pressured 
into partipipating, or^had misunderstood, or had been misled about the purpose, 
and scope of the "study, - it was also clear tha^ in a number of cases, coordinatojs. 

■ ■ • ■■■ - - ■ , 

approached principals or teachers they felt wg(GW be most likely to cooperate,. and 

principals did thQ same. All communications by the project \yith teachers priqr to. 

" *■ * 
pre-testing was through the diatrict coordinator, ^ . - 

In pari because of the non-random selection of schools and teachers, the 

~~ 4t~ District coordinator is our term. Actual positions in the school 

. systems varied. Somepoordinators were associate superintendents, 
^. some directors of social studies, some dir^tors of research, ^ 
some were principals, etc. - ^ ^ " 
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following data ware collected: , ' > * ^ 

, compleHon of the school chaxSctefistics .data described gibove. • 
' . * •* for the schools In^the p'tjojecti ^ • • v ^ 

' • .an interview with the district coordinator to establisk the numlfer 
* ^ of elementary schools in the district, the number of schools^he 

or she had approached; the number ot schools that refused to 
, participate; the number of teachers 'approached 'Who refused to^ • ^ 
- ' - participate; which MACOS.and noft-MACOS schools were most 

closely matched, arid on what base^; r 

r . - V , 

.background characteristics of teachers^ and several^standiar- • . 
dized attitude measuresV collected from' teachers^ , 

. 1 'background characteristics of students in each class 1[«r,g, sex, 

age, race^ eligibility for free lunch program, whether English . 
was theprijjjaary language for the student, years:ip pn6seiff' , ^ 
schoo^i whether .or not the student had previously htafcl MACQS ; 
and students' present readir^ levelj bas«d on stalida'rdiied tests 
and reported on a ^ poir^t scale (above; ,a^, and^below gracJe ^ 

level at time tested); these data were provided by tegchers. 

- I ' . ' ' ^ 

Analys'es of M^COS and non-MACOS classes have been tnade using many pf 
these va^a^bles, as will be described in Section IIL As noted earlier^^ables 
showing characteristics of claSses, teachers, schools and districts will be found 
in Section IIIB. The"' essential points here are that districts, schools and (for 
the most part) teachers were ndt randomly selected. T^iey met certain minimal 
criteria establisherfby the stuSy. Within those limits, there was »s elf-select ion of 

> ^ ^ , ^ ' . ' : • ' ' . 

districts and within districts^ It was believed, however, that the classes ift the study 
would>provide a broad range of student, teachor and environmental conditions 
under which the implementation otMACOS and non-MACOS courses could" be .ob-" h 
sened.' : , . ^ ^ , ^ * 

It should be noted that students also were self selected in some cases. 



The school.dlstrict was responsible for allo\^ing-access to students. In a few , 
bases. ^)^rents did not want ir alfow their children to be involved: In a^minis- ^ 
tering instruments to students,, studehts who did not want to do them were not 
pressured to dg io; similarly students who did not want to participate in inter- 
views were fipt pressured' to do that either. Students were always told that 
their teafeher* woi!ld not see the results of the forrnr they were doing, or the 
remarks they made in itfterviews and Jhat nothing wSiJld go in their school 
record or^affect their-grades^. • ' . ^ . . ' 

- As a final comment-ot^ selection process, it should 'be;noted that the 
project did not at any .time atteftip.tj6 seek non-MACOS programs that plight ^ 
be consider-ba ^tron^competing programs with MACC^. The project did not, ■ 
for ecample, attempt systematically to obtain Taba programs, or Holti)^ta 
Bank, programs,' fete. A variety. of alternate^progiiams do-'09Cur in the group 
of non-MACt>S^lasses. That is not by system*atic design, and no attempt to 
analyze specific non-MACOS programs is made in this report. . 

Measurement Desigft . ^ 

~ ' -This subsection describes the measurement^design, variables and 

•> * - _ 

^ instruments. * " ^ ' ^ 

.1/ Design - • - • 

There were six measurement, or data collectiotf,periods for all classes 

* So 

MACOS arid non-MACOS, as shown in TaBle II-2. 



Pretest 



Table/.!- 2 : Meaauiement .Design and Dates • • 
Midtestl*> Midtest2>r PostCest- ^ Follow-up 4' 'Follow-up 



> Pretest" . . 
Students 

♦ Data Cbllec-* 
t|on itord ^ 
Teachers 

^. bata Collec- 
tion from 
District ^ 
Coordinatars 



.Tape Class 
• 

. Interview 
' .Students 

^Interview 
•reacfiera 



.Process/ ' ♦Posttest 

Climate . 'Student? 

Question- ^ ' * ' 

naire ^r . Interview 

. Students Students 

.Program .Intervi^' 
Gharac- • Teachers $ 
, teristics . / 

Form for. 

^ Teachers " - 

.Interview 
Students 

.Interview ' ^ . ^ 

Teachers 



. Qlieition- ^ . .. Qucsti(;?ir- 
jiajre for ' naire foV . 
Studehts Students 

Jfttervlew (50% sample* 

Students .from^ach;*.* 

tjlass frlwn 
(50% sample ^>i;tpr yesup; / 
from each - samte sample; 
class'ff pm • * as Eollow-U£ 
prior year) ^ Up-1 to extent 

po'sstt^le) 



Sept/Oct 



iNov/Dec 



1974 



• Feb/^r.' ^ ApV/May . / CJctobcr^ 
: 1975 ' 1975 ' I 1975 



May 
197« 



.Pretest, midtest 1 and midtest 2 each covered 3 vt^eks. Ijdsttestlng lasted 3 1/2 



weeka. Follow up 1 and 2 extended for 2 weeks ^ch.* Witfc a few ekceptions, the sequence" 

^ / ^ ^" ' ■ h \ 

of scheduling of districts was the same for pre and posttesting. Thus, pre-post intervals. 

' ^ * . ^ u. . t o ~ 

wei*e the same for most classes, and within a two week range for all classes. '* * , - 
2. Variables and Instruments ^ ^ I 

' ' Variabtes ihfetrumdiits, data sources,' and time period of administration 

? — ^-T^_. ■ • • ■- ^ r ." ■ ■■ \ 

of data collection are listed in Table II- 3, A more detailed discission of * . 

' • '!■"-. 

" instruments, with appropriate author credits and citations, is given below. A 
:copy of each instrument except for th? STEP tost; is in Appendix ^. No alternate 
forms.of Instruments were used -for pre-post or follow-up testing.- One instru- 
ment (Study Choitfes, Number 2, in Table II- 3 ) was modifi|fl for (Follow-up '12 to- 



r 



Table 11-^ . . . ■ 

Infitfuments, «Variabias; Data Sources and Men Administeredi/ 



X, (SjEB-Social studies 
Series II, Form . 

■ ' ^J. '. "-^ 


Organizing, interprfeting and evaluating ^ 
informa^ionrvttith it-ems drawn from * 
different disciplines, such as history, 
Agecgrat)liyv\80Ciology, anthropology. . 


All Students 1 

*" if 


Pretest^ 
Po^ttest- , 


2# StuajrCnoicefiu^ ^ 
^' <5S(Dh).- • / 

V 


* • 

Affifiirip fownrri flonlsl ^tudi^S in* 
^ relation to other subjects (SS Ch) 

- • \ 


jftl Students 

V 

. IF 


Pret^sjt, - ^ 

Posttest, 

Fpllow-up-2 


3. \^Trat would You Think 

* * * 


. .Attitude toward unusual hypothetical* 
• Beliefs or c\istoras(WA) " * - 

.Attitude to)i(^ard pepple*who.would 
have those 6feli?fs or qustpms X^'^yB) , 


All Students 


PreJtes.t, 
Posttest, 
Follow-up % 


^. 4; Interpretation pf pata 


= ^ ^--^^ — t 1"- 

• ! Ability to m^ke logically dei^sible . 
. infer ei^ces (deductions) from ethno- 
• graphic &ata.^ v 

* * * • 


Students 
SetA^ _ * . 
1 of each 
class, selected 
on rapdoin 
basta ' \ 


Pretest, • - • 
Posttest^ 


5*. *dii{ldiren»s Attijtude 
// •?rowa%P^lem 
• Solving laventbry^ 
. -(CAPS) 

- ** ' . • ^ ' - 

- • i 


' .Attitude toward undertaking to ^olv-c^ * 
or Wx :k on problems 

. Attftilde toward self as problem 
. , solves -^-^s 

• Noie: A factor analysis was made of ^ 
the instrunmrft^nd 4' factors wer.c ^ * 
identified: ' ^ ^ 

. Ability of self problem ' ^ ... 
solves (CAPS-lK^' 
.inteiresr in probl em solvitig 
. (CAP5§^1*. ^ ' 
' , .Toleranc^'fpr ambiguity in 
« ' problems (CAPS-3): • . 
. Ke^ceived^eatiyity of self ' * ' . 

• ' • (dAPS-4) ' • 


Students 
Set B'. 
The.alter- 
natevrandoni'* 
half of the 
class ^ 

•*• 


Pretest, ^ / 
IPosttest 

*k * 

»^ • j» - 

• • 
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Table II Continuted 



Instrument 



Variables 



Data Source When Given 



6. A Questionnaire Abdftt ' 
Animals and People (AP) 



7l My Social Studies 
. Class (MSSC) 



. Understanding of certain MAG OS 
coiltse concepts as applied*to animals 
studied' in the coUrse and to the" 
Netsilik Eskimos. 

* 

• Knowledge of course* specific vocabu- 
lary 

(In Follow-up 2, only the-^eclion on 
vocabulary ^nd understanding of course 
concepts applied to animals was used.) 



Students ' _ Pretest, 



Set B 



• Feeling about Social studies this yeat, 
compared with last year (SS Conip) 

• Attitudes toward asking questions in 
social studies (Percep) 

. Preferred way of working (Alone) 

.Perceived amount of'teacher talk- 
(Listen) * * 

.How oftenithe student asks que9tlona 
' (Quest) 



Posttest» " 
Pollow-up 2 



All Students 




, • Attitude toward pacing of class 
(Speed) 

• Perceived eniphasis of social studies 
class on: 

Memory (Mem) 1' * 
Translation (Trans) 
* Interpretation (Interp) . " 
Application (Appln) 
Analysis (Anal) T 
Synthesis,(Synth)' 
Evaluation (Eval) 
Opportunity for Discussion and 
Involvement iODl) . 



Midte^t 2 
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Table H-3 ContlQued 



Instrument 



Variables 



Data Source vnien Given 



*Test/Grade Stress (Stress) 
Comparing (Comp) 
Informality (Joking) 
Lilcing Class (Like) . 
Teacher Talk (T Talk) ' 
Initiative (Init) 
Diversity (Div)' 



. Perceptions of 3 climate cKarac- 
'^fyi2l teristics: . ^ 

Satisfaction 
Apathy 
Difficulty 



\ 



\ 



8. ' My Social Studies 
\Class, This Year and 
—'LasMMSSC YLK 



0. 



, t 



r 



Perceived emphasis of present sbcial 
studies class on ^ 

Memory (Mem 1) 

Interpretation (Interp 1) 

Synthesis (iS^th 1) 

Evaluation (Eval 1) 

Opportunity fdr Discussion and 

Involvement (GDI 1) 

Test/Grade Stress (Stress 1) 
^lleacher Tallc^(T Talk 1) 
^r/ij|lvergence''\Div 1) ' 
" Liking Class (Like 1) 
' Comparuig (Comp^)^ 

Initiative (Init 1) 



Students: a 
50% random ' 
sample of " 
students from 
each class 
from preced- 
ing year , 



Follow-up 1 



. Feeling about*social studies class, ^ 
this year compared with last y^3r>;^ 
(SS Comp. 1) ^ y 

;Perdeption of ^n^ount of change 
(Change 1) . 

. Interesf in class this^year compared 
with last year (Interfe^^) p . ' 

.Perception of 'differences in amounts 
of specific learning activities this 
year compared with last year (Act. 1) 
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II-3 Continued 



Instrument.- 



Variables 



Data Source *Whea Givea 



). Social Studies Survey 
(SSS) 



ERIC 



p Perceptions of advantages otskills' 
and knowledge from last year in 
this year's class (know ; skills)^ - ^ 

, Opinions about gory or emotional 
topics studied last year (Emot 1) , 

. Opinions about suitability of 
such topics for 5th and 6th graders 
(Opinl) 



.Attitude toward social studies in 
relation to otiier subjects (SS Ch F) 

, Perception of emphases in present 

social studies cl^ss on: . 
Interpretation (Interp 2) 
Synthesis (Syth 2) ' " 
Evaluation (Eval 2) , * \ 
Discussion/lAvolvement (ODI 2) 
Test/Grade Stress (Stres0) 
Liking Clasa (Like 2) 

• How miich students like social 
studies/ English, scieiwe, , 
math/ each rated separately (SS) 

• Perceived amount of teacher talk 
(Listen 2) 

• Attitude towarcj pacii^ of class 
(Speed 2) 

• Recommendation of last yearns ^ 
class (Recom) 

• Perceived change from last iie^^r 
(Change Z) 

, Perception of differences in amounts 
of specific activities this year • 
compared with last year (Act 2) 

11-17 
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students: a 
50% rat^om 
sample from 
each class ^ 
from preced- 
ing year* To 
the- extent 
.possible, the 
same students 
as in Follow 
up-1 with re- 
placements on 
random basis « 



FolloW'-up2 



Table II-3 Continued 



instnunents 



V^ariables 



• rtofg Srtiirpp -men Given 



Student Master 
Roster and Back- 
. ground Form A 
(MRA) 



. Opinions about gory or emotional * 
topics studied last year (Emot 2) 

. Opinions about suitability of subh 
topiqs for 5th or 6th graders (Opiii 2) 

.Attitudes toward unusuaj 
hypothetical beliefs or customs 
(>yWAF) - * 

.-Attitudes toward people who would 
have those beliefs or customs 
(WBF) 

.Attitude toward certain- social behavior 
* of a hypothetical- peer (WAPF) 

. Attitude toward person having that 
'behavior (W'W'BPF),. 

- Knowledge of MAGOS course concepts 
applied to animalfij^d of course 
specific .vocabula|5^ (5P1-4FU) 

.Student Name , ^ 

.miich pre-post test groupj_A or B 
(Project use. only) . 

.WTiich mid-year group, A or B (not 
us?d) 

-rAge4a-mofifts , 

.Sex " . 

.Race 

. English as a second language 



Teacher 



y3 



■jPiretest 
(beginning 
of year for 
most items, 
with update 
during year) 



V 




' Table II-3 Continued 








Instruments 


• Variables' 


Data Source 


«• 

tVhen'Givea 






< 

. Primary language I 








e 


. Eligibility for free lunch program 










. Number of years in present school 


•» 








' ^ . Month joined social studies class 






% 




* .Month withdrew (not used) 
I. 




o 


V 

1 


11. Student Master 

Roster and. ^ 
Background . 
ForinB{MRB) 


it 

Teach^'s ratings of students:* 
.general academic ability 
.participation in class discussions 
i interest in social studies 


1 

Teacher 

\ 

■ V 


' Posttest 




• 


. mastery and understanding of social 
studies course qoncepts 

. .'general reading level .(ba§ed oa test 
scores) 




< 






> 

.how. often student applies what he/she 
studies ^ ^ - 






• 


12. Teacher 'Master^ 
Form Record 

« 


. Teacher background fhformation " 
.Pre-service and in-service training 


Teacher" 


Pretest * 




13. . Educational Scale VII 
• -(ESYU) 


.Attitudes toward educational prac- 
tices and values: 
. Traditionalism. (Trad) 
. Progressivisni ^rog) . 


> 





Table 11-^3 Continued 



14, Teachers at Work 
, scale (TAW) 


.Assessment of teacher behavior (T^W) 


Teacher^^ ' 


Pretest 


15, "Program Survey (PS) 

* 


. .Classification of own program with 
respect to six broad goals or orie^ta^ 
tions 

^. C haracter izatioa ot own concept *of 
social studies 

• Ranking of influence on teaching of 
(Jiifferent orientations 

^ .Ratir^s of relativeljmportaace of a 
variety of instructional objectives * 


Teacher 


Priest - 

V 

% 

■a 
if' 


< ' w 

16. Verbs for Objectives 
(Vor 


» Selection of verbs, best characte- 
rizing own objectives for the year 


Teacher 


Pretest 


17. Program charac- 
teristics " 

* 


• Frequency with which social studies ^ 
class has done different activities 

.Two most popular activities 

. Time characteristics of social studies^ 
« 

. Ratings of emphases of curriculum , 


Teacher 


Midtest 2 

• 




r-Units and-l^sonsJaught: 


Teacher 


Posttest 


' t8A;--^e0S Cburse^ 

Checklist 

• 


. Time spent on- Unit 

. iClaterials used 
^ . Ude of homework assignments 
^ . Years taught MACfOS 


• 


m 

0 

< 
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Table n-3 Continued 



Instruments ^ Variables Data Source . When Given - . 





' 9 

18B. Supplement for 
classes that had 
MAC OS and other 
programs 


.Text * . . ^ ° 

* 

• Units and lessons 'covered 

• Time spent on units 

^ • Supplementary programs 


Teacher 


Posttest 


r 


180. Social Studies Course 

Checklist (for non- 

. MAC OS classes) 
♦ 


> 

• Text 

.Units and lessons covered 
. Time-spent on units 


Teacher 


Posttest ~ 






.Conoprrent or supplementary* . 
programs oV texts , J ' . . 

. Use of homework assignments <^^ 
. Yeap^taught present program 




• • 




19, District Coordinators 
Form • '^V 


, Characteristics of district 
re? social studies curriculum 

> 


District 
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Pretest or 
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semester. 




20. Cost Survey 


• 

. .Costs of MACiDS and other social 
studies programs at same grade ^ 
level in dfetrict 


District 
Coordinator 

t. 
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be suitable to 7th grade as well as 6th by dropping two subjects, reading and 



■ • ^ V- ■ • • : ■ 

! V \ interviews with students rand with tcJachers had objectives and variables 
. ^hat sometimes complemented and^sometimes supplemented the variables 
. S-^^ listed in Table II-3 . Purposes of each set of interviews are given in 

Section V of this report; along withra detailed report of the results of the Inter- 
rv 1 • ; views* . ^ • ^ ' * : . 

c TheJnstrunfbnts listed in Table 11-3 Mil be discussed u^xt in the order 

^ in which they appear ia,th© table, t The purposes of the discussion are to: * 
"-i)provide proper acknowledgement and 2) give additional information that may \ 
help the reader understand what the study attempted to measure, how and why. 
a. STEP Series Hf^ Social Studies, Eorm 4a'(STEP) 
. _ ' This test is.piiblished by the Educational Testing Service, Princeton, 

New Jersey, 1969. It i? 50 item, tfme limited test. The pretest with this instru 
nient was administered by teachers. Posttesting with the'STEP was done ijv 
* Antioch prdject^^taff members. n ^ 

* ^ ^ The STEP test has norms and converted scores ^ prepared by ETS. In 

this study, only raw scores were used as measures, both for the total test and 



an^yses of sjub-tests. Sub-tests are based on an^item classification mSde by 
ETS undei; the following headings^* - * . 

Organizing information (e jtems)* 



5 . Handbook^for STEP Series II, Educ,ational Testing Service, ^Princeton, 
N(;\vJLersey, 197^, Table 24. X, p- lis/ / _ - - 
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Interpreting Information (25 Items) - . . ' 

" Assess Adequacy of Data (5 items) 

Draw Inferences an* Make Generalizations (11 items) 
Reach Conclusions Based on Evaluations (3 items) - 
b. Study'Choices (SS Ch) \ - [ 

This instrument consists of 15 items based oajthe method of pair com- 
parisoas. . Each of & subjects (social studies, arithmetic, science, English, 
•reading, and spelling) is paired with each other subject. The student is asked in 



each pair to pick thai one which he or she likes the most. ^ . • 

• : The instrument was uSed in this study to obtain a mpasure-of preference 

, " ■ c * » 

for social studies,relative to other subjects. The measure used wis the number 
of times social Studies was chosen, which could range from 0-^.. ' 

SEudyjChoices was included as part of the battery employed in Follow- 
up 2 (a^yXar. after posttesling)^_For that application readlng^nd spelling were 
deleted as subjects' bee ausje junior high schools (7 th grade) do not as a rule count 
reading a^d spelling as separate^subjects. The number of pairs, thenT in Follow- 
lip 2 was 6; the number of times social studies could be chosen as preferred was 
0-3. To distinguish the instrument in Follow-up 2, jt is eeferr-^d to as Ch F.'^ 
c. What. Would You Think (WA. WB) 

This instrument was developed for this study. It was intended to address 



6. Herrnan, Wayne L. , et. al. , The relationship of teacher centered 
activities and student centered activities to achievement and Interest 
in 18 fifth grade social- studies classes. AERJ , Vol. VI^ No. 2 March 
19691, 'pps..237-23'9!^"^ " ' 
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ati avowed goal of MACOS: "to awaken in children an awarenfes^ of the fact that 

7 

W^t we r^ard.as acceptable behavior is a product of our culture." The . 
formative evaluators saw this a^^the issue of ethnocentrism^' and^aborated 
as follows; . * - . ' ^ 

* ' "where the basic similarities in human behavicr have been_ 
^ graspjed, children demonstrate verbally, that the /Netsilik/ 

unit is having positive effect in creating a sense of the 
family of man. Do children go beyond the easy correlation 
„_of similarity, ho>yever, and begin to understand and some- , 
time enjoy the diversity of human behavior?"^ 

■ The formative evaluators of MACOS used semantic differential scales 



in an effSrt to assess this global concept and found relatively small pre-post 
changes.^ The evaluators also found, in their 1968-69*studies, that two true-^ 
' fajse questions concerning attributes coj^tmon and unique to all human beings 
gave results indicating lack of ability of 10-12 year old students to understaPid 
abstriact generalizations'put in the form of written statements. In their words^ 
"• . . the abstract, general statements do not elicit'an understanding response ^ 
- ..10 - .. . . . . . • 



.... o 



A search for other -a^e-appropriate. instruments ^fo^ measuring ethno-^ 

c^ntrism, or, convers&ly utjderstanding the diversity (and commonalities) qf hurpan 

behavior^was made with unsatisfactory results. A MACOS teacher proyiS«d a clue 

- ^ - ' ■ ' 

7. Hanley, Janet P. , et. al. , CuriosityZCompetence/Community. An Evalu- 
, ation erf Man; A Course of Study . .Education Development Center, Inc.', 
Cambridge, Mass., Vol. I, 1970, pp. 1-59 and 60. 

. V^. Ibid:, p. 1-60. ' . " 



9. ibid. , p. III-52; some changes were s^tistically significanCiyi 



to how to conceptualize the variables of this broadly articulated goal/ She noted 

that by the end of the year, she would not expect students to want to eat fish eyes. 

She would, however, hope that students could see reasons for the Nets ilik doing , 

so. She seemed, in"effecf, to distinguish attitudes toward act (or belief) from 

' - . - ' , ': - . 

attitudes "toward or understaading of the actors:.. 

A series of hypothetical unusual behaviors or beliefs was constructed. 

•For each one, two sets of four statements each were developed. The first 

set (A) contained four statements about the custom or belief. They ranged from 

very negative or rejectirig to at least neutral. Where iit was possible, the range. - 

extended to positive values. The. second set (B) contained statements^ about e 

person or group that would do^or think^such a thing. Again statements ranged' 

from very Negative or condemming to neutr. 1 or positive. Statements in eacho • 

set w,ere arranged in scrambled order with respect to intended negatlveness. An 

example is: , ' :^ 

If you heard that there was a country In which people often ate • 
grasshoppers and earthworms,- what would. you think? (Choose 
the one best answer for you in Column A, and then choose the 
one best for you in Column Bf ) " 

Column A ' Column B <^ 

, ^1) Some people may eat the%, but \) I guess it.m\ij?t uotdo them any 

' I wouldn*^ want to do that. harm. 

2) I never -thought that such things , ^2) I don't like peop>u with jjuch 

would be good to eati • * strarig^e customs. 

-3) Yuck! It makes me sick, just to ' 3) They have good reasons for 



think of eating them. eating them. 

_4) That's no different from our . . 4 ) li^ey sound like a backward 
country wher^people eat many group of people, 

things. ' ^ . ^v. 



" .The instrument contained 5 such ltenislnl^d€d4o.jainp a range of 
social-geographical distance: self; an undefined group in the United States; a^ 
undefined group in the western hemisphere; a u undefined group dutside the western 
hemisphere;, and an undefined group with no specified geographic location (the 
example given above)* ' ' * / V 

» The three criteria employed in pilpt tesyjQg the insticument with samples 
of students at the 5th and 6th gr.ade levels were that: 1) all choices should be . 
picked by at least some students; 2)*there should not be one choice in a set 
picked by 67% or more of the sttidertts^^gnd 3)^the vocabulary had to be under- 
standable to students who varied] w.idely in reading* levels. Students were inter- 
vlewQjd after administration of the form and asked about words thabthey were un- 

sure of. Tabulations of responses made by groups of students were* examined. 

^ • , ^ ,* 

Wherelnitial results showed that one or more of those criteria were ncrt being • 
niet, the choices (and wording) were revised and the instrument tried with another 
group of stude^pts until the criteria were met. Students each time were also asked 
for their suggestions about choices, afia al^ wh^it they thought was the differenc^i 
bef;ween choices in column A and column B. Sbme ^tude^its were not able to descri 



a difference. Some students would indicate that the first column A had to do with 
jwhat you thought about ""something; while column B had to do with what you thought 
about wKy people would do.it. The fact that at least some students could'articulate 
that distinction was taken as supporting evidence of construct validity. 



A soore or value for eaph statement in a set (A or B) for each Item \yas — 
developed by having ^samples of 5th and 6th grade students in the Washington, D.C. 



> • • . ----^ • ■ f - . 

area rank order the four statemenb inra set from most negative t,o most positive. 

Students were" taught how t6 rank order Choices; all situations and choices were 

* ■ . * " • • ' ■ ! ■ ' c . - 

read aloud to .minimize the problem of reading. One hund.ered qnd one (101) 

stttdetits, from classes covering a range of racial and socfo-economic compo- 
ffitions didttiel«4ginal rankings. The procedure was repeated In 1976 when 
two additional items were addecTfo^^e in Follow-up 2, The second group (225 
students) coyered the same ^rade, racial and socio-economic 'characteristics 

the first group. For the original and later groups separately, the statements 
in each set for each item were scaled b^uildford's method based on the assump- 
tion of a composite 'standard (with each set, A or B, for each itena, not across 
. sets or itenis).-*--^ A linear transformation of scale values for each Iget of state- 
ments^was made to a scale with a mean of 5 and a standard djeviation of 2. Com- 
parisons qf the transformed values of the two groups showed no important dif- 
ferences. Therefore each' corresponding value for the two groups were combined 
• into a .weighted average. ' • ' • | . 

" Transformed scores \\jsre rounded to. the nearest wkole number.^ This 
V occasionally yielded ties between statements within a set with respect to the 
score^assigned. For exampleTToMlie item given above the scores assigned to 

. statements in each set were as follows (the lowel^the number, the more negative 

' ■ ■ _ * 

the statement): ' <■ . ' 



11. nm-ldfnrd. ,T. P. / Psychometric Methods , Second Edition. New York: ^ 
r-avLHiU, 1954. SeeCh. 8, The Method of Rank Order; esp. pp. 
186-188. 
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Responses, on the mstruhient made by students^in the present.study ^ * ^ 
were scored according to the weights thus deriv^. A total'-acore for response^^ 
to column A statements was computed to provide a measured attitudes-ioward , 

; ' ■ » ■ - 

unusual acts or beliefs (WA). 'The total score for responses to column B • * 

statements y ere intended to measure attitudes toward people who would do or^ 

believe such things (Vi^T3)-. The range of possible values on bo\h scales is ' . , 

12 to 37, or when treated as an average, 2,4-7. 4 ' * * 

The scale values for two additioi^al items intended t6 measurfe a^ti- - - ■ 

tudes toward behavior by a 5th or 6th gr^ide peer were ba-s'ed on ranking-orderings ' 

by the same procedure as described above. • • - . 

^ • " ■ . * . ■ ^ • * 

■ d. Int erpretation of Data Test (IDT) 

' '• . ' ' 

This instrument was developed as pact of the taba Curriculum Develop-^ 

r ^ • ' - ' ■ " ' V- 

ment Project. It preWnts students'with a map>howingjem>*ins pf a. site once 
occupied by a group of lieople. Symbols and numbers identify where different " ^ 
' artifacts were found when the site was discovei:ed. .Drawings .and descriptrons ' 



12. Wallen, Norman E. , et. al'. , The Taba Curricujium Development ^ ' 
Project in Social Studies: Development of a Comijrehenflive Curri- 
culum Model for Social Studies "for grades One Tlirough Eight Inclu- • 
'.' sive of Procedures for Implementation and Dissemination, a ^jnal 
R6port, Project No. 5-1314, Grant No. OE-6-10-182,.."San Francisco 
C9I. , Oct. , 196.9 (ERIC EDj040106). Used' with permission of Qr. ^ • 
Wallen. • - ' • . 
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of artifacts are provided. The origingl instrument cohtained 56 multiple choice 

queflt4ons, such as: % 

• X * • - • * ' ' ' • * . ' 

y Object number 5 was. most likely in this axample: ^ 

/ . ^ . " ' ' ' ^ " '. 

,^ . • 1. a horn ^ - , . * / ^ . ^ 

- 2. a telescope " ^ • , . ' 

3. used to carry arrows ^ . \ * ' 

, 4. ii musical instniment ^ ^ * . 

5. iised. to carry goods to market ^ ^ _ , . 

The objects shown in the diagram and map might mean that the • 

- / ppnpig who lived there probably enpged primarily in: 

.1. farming ^ ^ . * ' > ^ 

2. ranching ^ % ' • * - ' _ 

7. trading- ' ^ , ^ • . 

' r "4. hunting , . ' • " \ " * 

* ; . 5. gathering. ■ ^ . * • ^ * 1 , 

^ » 6. hunting and gathering ' * v ' ^ 

• ^. farming *and trading ' - " ^ 

,8: hunting and trading' \ ^ ' ^ ^ " ^• 

; ^ , 9. none of these > - : - 

For this study, two items having to do p^tmarily with map reading skills 
\ / were dropped to reduce administriition time. 13 One other item was not included 

- iti'tiie scoring. Thps, IIQT in this study contains 23^ of the original 26 items, 
the range of possible scores is 0-23. , ^ 

The rationale for its inclusion in the study was that it appeared to tap 
\ ^-skills important fn IVpfCOS as well ns many other upper elementary social studies 
/programs.. A MAC OS instrumental or pedagogicaf objective is: 'Ho help' 
' youngsters to develop'-the ability*!© use ii variety of first-hand sources as evi- 



13, It was assumed that these skill's were adequately covered in the^ 
• . , STEP test. ■ 
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"^'^ : dence from which to develop hypotheses ^nd draw conclusions. The IDT 

,. * t ~ " 

, was chosen as one means of assessing that objective. 

. - * The, instrument was*administered pre to a random 50%.samBJe of stu- 

^d^nts ia each class (called Set A in Table 11- 3 ), and post to the same .students. 



e. Children's Attitudes Toward Problem Solving Inventory (CAPS) 
This instrument, developed By Dr.' Mar^ L. Covington, University of 
California, Berkeley ,was his revision of the earlier CAPS described in. Johnson- 
and.Bommarito, and was used in this study w^ permissioa of the authpr. 
It contains 33 items v/hich are, raf)ed by student^ on a 5-point scale, ranging from 
"^strongly agree to strongly disagree; One item was not used in scoring the instru- 

meat* . a 

«• » ' 

' ' The instrument was selected for use in this study as one means of 

assessing a major thrust of MAC OS: developing personal self confidence. The 
/ ' ' ' • - ... 

course is designed to facilitate interactive learning. It^emphasizes encourage- . 
meat of bpjnion-giving, reflecting, listening, exploring ideas and hunches, tt 
aims to 'Uegitimfze the search; that is to give sanction and support to open-ended 
discussions where definitive answers to many questions are not found. CAPS 

- ) 

^ is intended to assess attitudes toward problemsolving and toward self as a problem 
^soiver. It was hypothesized that MACOS should have positive effect^ on such 



/ . 



14. Hanely, Janet P. ,'et. al. ,' Op. cit . , p. 1-5. y 

o « ^ . 

15. Johnson, Orval G. , and Bbmmarito , James W. , Tests and Measurements 

in Child Development; A Handbook. San Francisco: Jossey-Bass, Inc. 
1971. See page 436:, A Child Attitude Inventory for Problem Solving 
(CAPS) Richard S. Grutchfield and Martin L. Covington, authors. 

16., .Hanley, Janet P. .'ef. al. . Op. cit. . p. 1-5. ■ '<r 
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attitudes. CAPS was therefore included in the assessment battery used in-^his 
study. . ;r • 

• Thelnsfruhient can provide a total score, and Covington provided the 



project with the key to scoring two sub-sets of items intended to measure the 
attitudes stated above. The Antioch project, in addition^ did a factor analysis 
of theCAPS, using the pre-test sample of students. B6sed on listwise deletion. 



17 



the analy'Sis was carried out on th^ responses, of 927 students. Four interpre- . 

* \ 

table factors were identified. 'These are described below. Subsequently in this 

report they will be called* CAPS 1, CAPS 2, CAPS 3, and CAPS 4. 

GAPS^IY Perceived ability of self as a problem solver (5 items) 

Illustrative items: - * 

. I often, make up my^mi'nd too quickly about the answer *o a prdi^Iem. 

.When rm trying to solve a problem, I often don't know how to get 
-starfed on it. * 

.Most of the students in my class are beteer at solving problems 
' *' ^ - than ram. \ ^ ' - ^ ' ^ 

(the more the student diisligriBes with these statements, the higher the score*) 



.CAPS'2: Interest in problem solving (6 items) 
Illustrative items: 



.When I don't understand sor^ething in class, I am very ready to 
ask questions about it. ? 

.1 am eager to learn. ^ . , * 

.1 like to work on problems like mysteries and puzzles that'make.^me 
-think 



Ij^ A test was not included if there were one or more missing items or 



invalidly answered items. 
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(the more the student agrees with the. statements, the Ijigher the score.) 
CAPS 3: Tolerance for ambiguity in problems ( 9* items) 
Illustrative items: 

» 

.1 would usually rather work on problems I know I can solve than 
* on ones that^m^y be too hard for^me. ' / ' 



.1 don't like fhe kinds of problems that have mrore than one right 
answer. - ^ 

.When you/are working on a problem, it is best to keep 
away from ^'wild''. ideas b^ause they may throw you off the right 
track. • . 

(the more the studejjt disagrees with'the'.statements, the higher {he score. ) . 

CAPS 4: Perception of self as cre3nve'( 7 items) , W * 

Hlustratiye'^ items: * 

' .1 am able to get unusual ideas - ideas that other students don't . 
often think of. w . , 

A have the makings of a really creative thinker. ' - 

.1[ like thekin.ds of problems that nobody really knows the answer to. 

(the more the student agrees with the 'statement, the higher the score.) 

CAPS was administered pre and post to the half of the class (Set B) that 

did not take the IDT. '"^ ^ C 

f. A* Questionnaire^About^Animals and People (AP) 
.. — ■■ ^ ■ ■ ' — ~ « » 

^ ' This instrument consists of items used in the MAC OS formative evalua- 

tion, *and subsequently inclftded^s Content Questionnaires I and n in the MAC OS 

' 18 ' - * ' ' 
f; valuation Sfrategies. • - 



~~i;87 ~MACC^ Evaluation Strategies .'' Education Development Center, Inc. , 
.'' Cambridge, Mass. , 1970. Disseminated afid produced by Curriculum 

. ' Development Associates^ Inc. , Suite 414. 1211 Connecticut Ave.«j, N.l^'. 

" . • Washington, D.C. 20036^ Permission to use items was given by EDC and 
and CDA. ^ . - 



E£|C .... -• ' • .1^5 



ERIC 




An analysis of items was done'for'the Antioch project by Dr. Henry 
WaUxesser, then the Director of the Sureau of Education Res&arch and Field 
Services, College of Education, University of Maryland. Items were classified 
as acceptable or unacceptable for, the purposes of this study. An item was con- ^ 
"sidered unacceptable if: 1) pretest results suggested that a 90% knowledge level C 
already existed in the learner population; or 2) the content of fhe item appeared " 
to make thj^esponse set difficult to interpret; or 3) the response set did not 
yield data that could be scaled. . - - * • , 

Items were selected from the set classified as acceptable. Instructions 
and response formats were modified for severaUtems. In. the case of one item, 
4 sub-items were added that were not in the original item. The instrument used 
in thisstudvr contained 4 items, with multiple parts, pertaining to thfe Jdan and 
Other Animals unit of the course (APl-4), "and 4 items, alsorwith multiple parts , 
pertaining to the Netsilik unit (APS-^'s). Three scores were obtained: a tqtal score, 
and a score for each of the two main units. ^® The range of possible total scores 



was 0-45^ for APr-4, 0-24; for AP5-8, p-21. . 

AP 'vas administered pre and post to one half of the students (Set B) 

t 

the ^ame group that "also did CAPS. APl-4 was included in the ' 
ed a year after the course was over, in Follow-up 2. 
Mv Social Studies Class (MSSC) ■ 



in each clasa 
instrument us 



-This 



attitudes and 



instrument has"3"parts. The first part contains 6* item^ about 
)references.-in social studies. Five of the 6 items were'modifications 



19.. For tjie. reasons descriljedv the^cores obtained in this study cannot be 
compared with the scores and norms provided in Evaluation Strategies. 
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of items used inihe MACOS formative evaluation study The other was a 

modificatioa of ari item in Steele's Classroom Activities Questionnaire (CAQ). 

Part n MSSC contains items taken from the CAQ and modified, after 

extensive pilotting, to make them intelligible to 5th and 6th grade students. 

The CAQ contains 27 ifems intended to measure 5 dimensions of instructional 

climate, as perceived by students: ' o 

I. Emphasis- o&Jower thought processes - 3 scales based on Bloom' 
Taxonomy; 2 items per scale. 



2. Emphasis on higher thought processes - 4 scales based on 
Bloom's Taxonomy; 2 items. per scale. 

si Perceived classroom focus on active or passive roles of 
teacher and student in information giving. * ' ^ 



4. Perceived classroom climate - how relaxed the class is. 

* ' <» 

5. Student opinions on qualities and deficiencies of the class. 

•The CAQ is not intended for use with students below the 6th grade. Pilot 

tests made by this project indicated that both 5th and 6th grade students often 

had difficulty understanding, some of the items. Further pilot testing was done 

with revised wording of items. Major criteria for acceptancre were consistency 

of responses to item, pairs forming a . scale, differentiation of classes on scales, 

and ability of students interviewed after doing the instrument to give afipropriate 

explanations or examples of what selected items meant to them. The items parti- 

cularly-in need of rewording for younger students .were those related to different 

' < 

20 . Joe M. Steele, Classroom Activities Questionnaire . Copyright, 1969. 
I'his instrument was modified for use in this Jiroject with permission 
- of the author. ^ ^ . • 

21. From material provided by Steele. , 



levela of class activittes accordiag to Bloom's taxonomy. * . , ' . 

The ino^ificatioii of the CAQ used in the present instrunient consists of 
'25 items. The response format used was Agree ;(=1) or Don't Agree (=3) instead , - 
of the 5 point scale ]n the CAQ. .Scales base(? on pairs of items-ttierefore have 
values of 2, '4^ or 6^ with 2 and 6 indicating perfect consistency after necessary 
polarity reversals ai^e made. o 

Part ni of the MSSC consists of 25 items forming 3 classroom climate 

■ ; • ■ . ' . - 

scales: 

Satisfaction (9 items) .» \ ^. 

Apathy (7 items) 

Difficulty (9 items) ' ^ * * 

The Satisfaction and Difficulty scales come from Anderson and Walbergla 

My Class instrument.^^ The Apathy scale is from Anderson and Walberg's 

^ 23 ' ' 

Learning Environment Inventory (LEI). . ' ^ 

V 

Items were modified in some instances to include the words "social 
studies" since extensive pilot testing of these and other scales had convinced the pro 
ject tr.at unless young childrea (5th and' 6fh graders) were constantly remiaded that 
statements were intended to refdr specifically to' the social studies class, they , 

» s 

would often respond with some other, class in nTind,. The response format used 



■for the item was,. jg.aJn, _Agxee_(=l)-or--Don^trAgree'(=3)v wlflTfRe necessary 

22. MV Class was developed by Gary J. Anderson and Herbert, J. Walberg 

at Harvard University, May 1968. \ ^ - , 

23. - For information on the LEI and My Class, see Anderson, Gary J. 

'ghe Assessment of Learning Envii'onmerfts: A Maliual for the Learning 
Environment Inventory and the My Class Inventory . Atlantic Institute 
of Education, Halifax, Nova Scotia, Canada, February, 1971. 
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reversals of polarity made to accumulate item scores into a scale* 

'M v social Studies Class (MSSC) was administered to all students itlfeach'^ 
class in February/March, 197.5 (midtest-2). The instrument was read aloud to 

students by the person administering it to minimize variance arising from varia- 

- '. ^ - " ' 

tions In reading ability among students". - : ' . . ' 

. ' ■• - ■. 
■■ ^ " 

, -h. 'My Social Studies Class. Thig Year and Last (MSSCYL) ^ 
This instrument was- administered in the first follow-up (Follow-up 1> 
to a random sample of 50% of the students of each clasj^ studied during the pre- 
^os|; year. As with the MSSC, this instrument was administered t6 groups by 
having the tester- rea(J t£e questionnaire aloud*. ^z-- . 

MSSCYL contained^some classroom process and climate items from the 
MSSC^ The major part of it contained items and rating scales designed to assess: 

.differences in social studies class this year, compared with last 

year; \ . : - ^ - 

, • ' . - *^ ' , / ^ ^ ' ' . 

. extent to which students believed what they had learned last year 
was advantageous .to them this year; 

. students* present reactions to a Variety of emotionally charged topics 
. I' that may have been studied the previous year in social studies.; 



' i. Social Studies Survey (SSS) 
This was thfe final instrument .administered to students— It was given in . 
the final follow-up (Follow-up 2) to the 50% samfjjfe of students from Follow-up 1, 
with random replacement when necessary to maintain sample sizes. 

The instrument contained items fromjthe„MSSC-and MSSaYtr Th"esV ' 
• were read aloud to students. It also containedVe modified Study Choices (SSCh F) 
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What Would You Think (^W) ,^ and the animals section (AFl-4) of the Question-^ 



haire About Animals and People. These were administeredln the same way 

— ; — — ^ — : J . ^ . * ' «- 

that had been done in pre and posttesting. that is, instructions were read to 

students, but items, were not. • ' 

j. Student and teacher background informatioA '^^^^ -« \ 

• (Instruments 10^ 11, and 12 in Table n-3 ) were designed by the project 
^ ' ♦ * «• ' 

and are self explanatory. . - 



k. Educational S cale VII (ES VII) and Teachers at Work (TAW) 
' r — ; 7^ ^ 

' ' - ' . ( 

^ ES Vn and TAW^were instruments completed by teachers at the.beginning 
of the project (pretest). The forms were riot administered but were cpmpleted 
by the teacher at his or' her convenience. ' • * 

The purpose of the instruments in this project was to provide a set of 
attitude variatdes with respect to teachers, using standardized instruments, • 
that would help answer the question of whethei*s there were systematic differences 

. — y \ ) ' ^ r 

between the MACOS and non-MACOS teachers in the study. It was also of inte- 

rest to assess possible relationships bet'^'een teach^rjttitM^^^ 

teristics, and outcomes within the two groups.' ^ * 

The ES VII is a 30 item instrument using 7 point rating scales to produce 

24* Education Scale VII was . developed by Fred N. Kerlinger and Elazar 
S. Pedhazur. ^e Kerlinger, Fred N^^ and Pe^iiur^^-Elazar-Jr 
Attitu^des_an(ll?«^ Traits and Behaviors of 

-r- — ^"^"Teachers. Final Report, September, 1967, New York University, 
* Project No. 5-0330, Contract No. OE 5-10^024, United States De- 
... . ' partment of Health, Education and Welfare. tAW was developed by 

Pedhazur, See Pedhazur, Elazar J. , Pseudoprogreissivism and Assess- 
^ ment of Teacher Behavior, Educational and Psychological Measurement, 

Vol/ 29, No. 2, Summer 1969, 377-386. ' . . ^ 



' 11^-37- 



130 



— -a sunmiated^Score on 15 fraaitioaalist items and a score on 15,progressiviam 

it^ms. The TAW consists of 6 episocles involving an interaction between a^teacher 

. • • • ■ ' ' \ 

. an4-8ti}deats. .The respondent is' asked to evaluate the teacher's behavior in 

(pach episode by iiiaking a rating on a six point scale ranging from Very Poor to 

Excellent. "In each episode, the teacher exhibits some or all of the following 

behaviors ! •manipulates the students, encourages destructive criticism, intra- 

!^group-aggi>ession, competition, confession and the like.'^^^ The more the 

respondent rates the behavior described as poor, the lower the^gore on the TAW. 

1. Social Studies Program Survey (PS) " * . 

This instrument, developed by this project, \Yas intended to^assess 

major orientations or views of teachers about social studies. It was completed 

- / • ■ . 

by teachers at the beginning of the groject (preffest). 

' ■ ' ■ ' / . ■ ' 

. Part I described.what appeared from a review of literature to be major 
orientations or goals of social studies. Teachers were asked a series of ques- . „ 
tions about their opinions oftiiese_gMU,J[ttci^ the aims 



:; of Oieir own program were, adequately described by one or pipre jof the goals. 

i ^ . . . 

I Part II consisted of 40 objectives intended to bjp approi>riate to the major 

• ' • ' ■ • - ■ — 

orientations or goals d6scribed^i|LPa^i^t^It plus two generaj categories of jbjec- 

tives. Th« teachers was asked to rate each objective by applying the following 

sentence and scale: • x . 

"If I had. to choose only from this list to pick^^instructional objectives 
^ for my social studies program this year, I would consider this 

objective to be: ' • , 



25. Pedhazur, Elazar J. , op, cit> , p. 381, 
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!♦ essential \ • 

2» important, but not essential 

3. desirable to achieve if possible, but of secondary importance 

4. has some positive value, if all else is achieved 

5. irrelevant or inappropriate to what should be accomplished in 

or by my social studies program, r ^ - 



Illustrative objectives are: . ' 

\ develop tfie ability to expect, recognize and adapt tp social change, 
.develop library research skills. . 

.develop an appreciation for the diversity in human behavior, biel^efs 
and customs * - 

. develop knowledge of facts and concepts that are basic to under- 
stand ir^ our cultural heritage ^ 

.develop the ability to judgp the validity of evidence and draw sound 
conclusion from. data , . ^ ^ 



^ „ .develop skills in analyzing social issues ^ ^ v \ 

\ « ' . ' ^. * ^ " \' 'Y' '^'-^ ' 

' 1^ ^.4evelop an awareness of the similarities in differ ent\cultures< 

\ For purposes of analysis, item scores for each category w^e cumulated 

\ , , • - 

and converted'to a scale ranging from 1 to 5. 

m. Verbs for Objectives (VP) 
This^ instrument \vas designed by this project as one means of assessing 
the interest of teachers in.applicatio^n of learning in social studies. It consists of 
a list of 30' verbs. Instructions were tdsimagine writing terminal performance 
objectives for the course and to pick the G^rbs most liHely to be used in formu- 
lating those objectives. Examples were^^iven oUiow terminal performance 



objectives couta be stated* It was administered ia'the pretest period, 

. n < . - ■ 

The list of verbs had been prepared from a list of 80 that had been rated ^ 

♦ ^ 

by 17 upper elementary social studies teachers on a 7 point scale ranging* from 
Z*^ 1 (almost ce^a inly application emphasis) to 7 (almost certainly acquisition of 

knowledge and skill emphasis). The middle value was 4 (neither one nor the 

i " , " . 

other, or cquld-bo either). Nine verbs were rated 1, 2, or 3 by 60% or%ore of 



the teachers, Ctf these, 6 were chosen on a random basis. Six verbsu^Jrt^h 

the most teachers rated 5-7 wei^included. The other 18 were chosen at random 

' - . I ■ • ; . / : ■ 

from the remaining list. « ' - 

/ - Retiring was done by making a count of how many of the six high-rated 

application verbs were selected. The six application verbs were; defend, de- 

sign, interact, invent, share and use. -Verbs that had tended to be rated as empha-'^ 

sizing acquisition of knowledge or skills as major goal were; analjrze, define, 

' • - • ' •'• 

know, recall, remember, 3Bd understand. 

n. Program Characteristics Form 

„ This instrument was intended to jDbtainfiJi Part I, information from tea- 

cHers about the relative frequency of different activities in their social studies class 

/ * 

and^in Part II, information about most popular activities.. In Part III information was. re- 

i * 

quested about how long and how often classes were held; also, teachers were asked 
to rate the affective emphasis of the curriculum and emphasis with respect to ^ . 



26* If it is assumed that choices are rai^dom, the expectation for any 
score can be determined from a hypergeometric probability distri- 
bution. The distribut|^^of scores for a group can thus be tested 
against those expectations. 
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different level of Bloom's Ta xonomy of Educational Objectives; Cognitive Domala ,^^ 

^ \ -- ---- . — , _ [ ; 

The;snstrtiment was administered to te'achers in Febi^ary/March 1975, 
midtest 2, at* the same time Mv Sobfal Studies Clasg (MSSC) was administered to 
sttldents* , ' • ' . -i? ; - 

* , Part I.consisted oT^i list of 43 activities. Eachiyas rated on a 3 point 

i ■ ^ 

Scale of 'frequency of occurrence: 1-Never, '2-Occaslonally <up to^ 6 times), 



3-Fr^^^ently <very often). Item^were cbssified by apaneljofjou^^ 
with respect to specifications of Mode (primarily reading, primarily oral/aural, 
primarily perceptual,motor, primarily observational, can'ftell), andofMethpd' 
(primarily. Individual, primarily group, caa'ttell). . Items were grouped, on the 
basis of 3 out of 4 agreements on a cla^ssification, into four mairrsets for pur- 
poses of analysis of datal \ * ^ > . ^ 

* ' ^ iPdlv . (\ndividual Activities, regardless of iMode - 9, items) 

r - . . 

Group (Group, Activities y Oral/Aural mode - 9atems) 
PM (Perceptual-Motor Activities, rega;:dless of method -4 items) ^ 
Total Group (All Group Activities, regardless of mode -16 items) 
. ^Illustrative items for each are: 



I 



Indiv: 



J- 



- , .Writing reports 

..Writing poems or stories 



27. Bloom, Benjamin^ (ed), et al. , Taxonomy of Eduqational Objectives 

H andbook It Gognitive Domafn, New York: Dav»d McKay Co. , 1956. : 
Opinion items in P'art III were adapted, with permission, from scales 
contained in the Curriculum Materials Assessment System (CMA^), 
developed by the Social.Science Education Consortium, Boulder, Colorado. 

' " . /■ • . ■ 
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. Taking teacher's tests and quizzes 
■Group; 

« Discussing ideas and opinions of classmates ' ^* 

• Having social awarenes^ group m'eelings (Magic Q^ircle, 
Inside/CXxt, Sensitivity groups, etc) 

• Discussing how to make a better world 
* PM: .(Perceptual-Motor) 

. Making maps , * * * • 

. Making^charts^ox^raphs . ^ 

. Drawing pictures 

Total Group (A dditional Items): * 
) . ' t> >' 

. Working in small groups 



Playing social studies games 
^ Doing group projects 
The'remainder-of the instruments in table II- 3 were all designed by 
this project. They are self-explanatory and can be seen in Appendix^A,. 

* , 3. Procedures 

a. Assignment of s*tudents to test groups - 

* ' - As described earlier, the students in each* class were divided into . 
two groups, for purposes of adpinietration ^f certain pre-post instruments. The 
basic procedure was to take the class roster, which the teacher had been asked to 
have available, and take every other student for one^roup, with the remainder 
^oing intQ the. other tgroup. .Which group was called A and which B was determined 
.on a random basis. For non-graded classes, two class lists were used with the 
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same procedures applte<rto obtliiQ'Sth an4 6th grade level representation in 
§a0h'group, ' . • . ' v . ' ' ^ . ^ 

AdministrafioR ofVistrumePts ^ ^ 

With two exceptions, all instruments were administered to students as a 

... , . . . 

ipcmxo by a projoct staff member/ The major exc^titm wasihe.STEP pretest, 
which was administered by the teacher. The STEP posttest was administered to ' 
students by a project staff member. The other exception was Ihe QQse tff students 




ivmh^^re absent on the day of pretesting.!- Teachers subs'equently administered* ' • 
the pretest instruments to those individuals. . * • . 

. ? " . ; - ■ • • 

, Instruments distributed to Group A and B students in previously arranged 

packages were administered to the class in the following order. All students fi^st 

combleted Study Choices {{t£m which the outcome measure social studies choices - 

SS Ch - was derived). Instructions were r'aatf^and th% first pair of choices were * ^ 

ead to assure Jllat students understood what they wer.e to do, jPive minutes wotc , ' 

allotted for Study Choices t although the classes typically finished^ in 2-3 minutes. ^ 

^T\en students finished, What Would You Thiik>i^ (WW) instructions and the first ques- 

tion were then read aloud. Twelve minutes were allotted, with an extra three - , 

minutes When necessary.' Then Group A students were asked to start reading to 

' , * * , 

themselves the instructions for the jnterpretation of Data Test (IDTJ while the 

^ *■ • 

test administr^tortthen read with Group B students the instructions for the Children's 

•* . ' <• . " ".' 

^Attitude Towards Problem-Solving Inventory (CAPS). When Group B was started, the 

' ^ •/ 
test administrator returned to Group A, read the instructions to students, went over 



•28 . A code was entered in the file on a student by jjtudent basis indicating whether 
an instrument was administered by the project or by the teacher. " 



the map, Explained symbols and numbers, gave example^ from the list of illu- 
'atrations of objects, and started students on the first question. Thereafter, 
the test administrator answer^ procedural questions for both^groups, but not 
questions of jvord me&ning or other substantive questions.-^-Group B preceded to 
do the ^uestionriaire About Anim&Is and People (AP) following completion of 
CAPS. Total administration time was 50-55 minutes. The vast majority of stu- 
dents were able to finish in that time. 

Administrated^ procedures for posttest ^Vere the same as for pretest. 
The STEP test w{is\.adihinistered in a separate ^es^ion. In Follow-up 2, some of 

■ -■ ■/ Jix- ' ■ ■ ' " 

the same instrtfmjBnta;(or sub-parts) were repeated as part of the overall Follow-up 2 

- .1 If/ . 

form, ^^'hile all |nMructions and items in tlie rest of the Follow-up 2 questionnaire 

,' - " r ///' . . - ' 

were read aloud jtpp^tudents, those parts repeated from pre and po^Hr^st were 
administered as|tfaey had, previoual&been, with only instructions read aioud. - 

Othfe^-fo|:ms administered to students (midtest 2 and Follow-up 1) were 

' J * , * / 

read aloud inJtt>to i6 minimize variance owing to differences in reading ability. 
Forms completed by teachers wefe, with one exception, done at th/teacher*s con- 

I '/ }¥■ ' ■/..-■ 

venience (L e. they were riot adjtninistered directly by a staff member). In mid- 

-■- \m ■ • ■: ■ / . ■ 

test 2, teachers w^efre/asked to cdmplete the Program Characteristics Form while 

the test ac'minislTat'oy was dojng My Social Studies Class with/ students. The 

• . ' ^ - -■ / - /' ■ . 

District Coordinators Form^ was completed at (:he coord inatjp^rs convenienae. 

- . ' / • ' - " . • 

c' Interviews with students / . 

• • ■■ ■ , . ■ - / • 1 • 

Interviews were conducted with students at midtest 1 (November/December 
1974), midtest 2 (February/March, 1975), posttest (Aj^ril/May 1975), and Fqllow- 



up^l (October, 1975'). In midtest 1 and 2 and pCsttes^ interviews, 4 students from 

■ . / - . 

'J 
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each class were interviewed as a group. The basis of selection was random. 

' Essentially students in Group A and in Group B were listed* and then each student 

in- a Group was assigned a sequence number from a table of random numberis^ 

The interviewer then asked to interview the two students in each group with the 

lowest sequence number (01, 02,, etc.). If a student was absent, or had left the 
**■ • , « • • 

class, or did not want to participate in the interview, the interviewer then picked 

as a replacement the student in the appropriaVe group with the next sequence, 
number. In the next round of ^interviewing, the interviewer continued with the. 
5ame lists, selecting the next four students from the remaining sequence numbers. 
There were cases in which the lists for a class were ejchausted before completion 
V r }^ of the three baseline year interviews. When that occurred/ the interviewer re- 
• cycled through the sequence nuinbers. There were several reasons for using this 
procedure. One important reSson wzs to be able to assure students that they had 
" not been selected on the basis of grades or performance in school or any other 
personal basis . ' - * 

J Interviews were tape-recorded. Students wei^ always assured that 

the interview was private, that their teacher would not hear^what they said. 

:^ ^ ■ - . . • 

Interviews with students and \yith teachers were desfgned to Isist for 20 minutes. 
Some ran longer, but seldom shorter. * 



.29 . . Section V of this report contains detailed descriptions of the purposes 
\ of each interview, how they were cjxied and. results obtained. 

30 . It was explained to students each time that they had been chosen oa a 
random ba;5is: .j fike drawipg names out of a hat.»; * 
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\ « d, Tap€t recording classes ■» 

' Nearly^all classes in the sjtudy were tape recorded in Midtest 1 

' " (November/December, 1974). Schedules were arranged in advance with 

teachers. Taping was done by the field staff member using a portable, bat- 

. tery: operated Sony TC llOA recorder and a hand held Beyer Dynamic M 260 , 

N(Q directional inicrophone. Typically, the person doing the recording sat 

at the side of a class near the.front, moving the microphone back and forth 

-as speakers changed. The primary objective. was to record teacher state- 

meDts,with as many student statements recorded intelligibly as possible. 

If the class broke into Ismail groups for a time,the procedure was to sit in 

with one or more groups for periods of about 5^7 minutes each. 

e. Assignment of fi^ld staff 

Five field staff members, including t^ie principal investigator, wer^ 

assigned specific districts toj^e covered from pretest through Follow-up 2. 

The primary reason for that procedure was to enable students and teachers to 

become familiar with the staff. member; thus rapport and continuity were the 
, . ' - - »• 

* * » .\ 

overriding considerations.^ Tor certaia periods (e.g. , posttest) when schedules 

^ ^ ' • \ 

were very^tight, staff members cover ' ng proximal areas would be assigned 

to jfissist in a different district with some data gatKering (e.g. administration 

of STEP tests). Four of the. original five staff members wef^ able to continue 

^ same districts from pretest through Follow-up 1. One staff member 

continued from posttest through Follow-up 2. For FoIIow-up 2, two new staff 

members were involved in the admfniplration of the final qqestionnaire. 
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f. Preparation of data- ^>^^'» , ' . 

Item responses for each instrument administered to students were 
transcribed onto data sheets by the individual responsible for test administration. 
ID numbers were added by the central project staff. Data were keypunched^ 
and put on tape and art edit and verification routine done for each item. Errors " 
thus detected were rfeconciled-by reference to the original questionnaires. 

Scoring of instruments wias done by machine.. 

_^ ' " " » " • 

^ g. Follow-up samples and procedures ' * * , 

A 50% sample of students fronj eachuclass;was wanted for follo^y-up 
-purppses. Yox classes with less than 13 students, all students-were sought. 
For classes with 14 or more students who had been in the class the whole pre- 
ceding school year, an approximately 50% sample was dra.wn.from the class 
list, on a systematic basis, using a random start. The remainder of the students 
were listed fn an order determined froni tables of random numbers. _ 

* 

• Ultimate criteria for inclusion of students ia Follow-up 1 and 2 were: 



\ 

\ 



.they had to have been in the preceding year's class all year; 

^ ' ' ) ^ • 

.they had to be still in the same district; 

^ . seventh grade samples (from the preceding year's 6th grade)-* 
for^any given class were limited to the majority presently in 
np more than two different junior »high schools (the same cri- 
teripr was applied in 3 few necessary instances to the preceding 
year's 5th gfade students). 

With the assistance of district coordinators, lists were provided to 

principals of the primary sample of-^atudents desired, with the list of replace- 

ments, and visitati,bn schedules were arranged. Students from a given prior 

cjass were brought tc^ether as a group. • Replacements of missing students were 
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made by going dowathe list of randomly ordered alternates. In Follow-up 1 
the form My Social Studies Class. This Year and Last w as administered by 
being read aloud to the group. Following that, >a brief interview was conducted 
with the group as a whole. In Fpllow-up 2*the form Social Studies Survey was 
read aloud to the group; tl^ere was no final interview. Jn some cases, as noted 
above, the procedure called for seeing two sub-^roup^ 
StudentsjKere^o^^brtH^ schools. In a few cases, it 

was tfecessary to, have groups composed of students from two different prior 
yearns classes. 

In Follow-up 2 effort.was made^to see the same students as in 
Follow-up 1 since it had been found in Follow-up 1 that in a number of cases 
it ^vas necessary to draw substantially from replacement lists. The overlap 
from Follow -up.l to Follow-up 2 was about 80%. * • 

C. Reliabilities / . " . 

/ !♦ Main Pre-Post-Instruments 

Generalizability coefficients'were computed for the main instruments, 
or sub-tests within them, that were used as pre and post measures. 31 Coefficients 
were derived from pre-test data, and were computed for classroom nieans and 
for individual student scores. They were computed for the combined MAC OS and 
non-MACOS groups, and or the two groups separately. The design for the compu^ 



31. 'Crpnbach, Lee J. , Gleser, G.C. , Nanda, H., and Rajaratman, N. 

. ^ * The Dependability of Behavioral Measurements; Theory of Generalizability 
for Scores and Profiles. New York; Wiley, 1972. The compute program 
ui3ed was GENPROQ, prepared by Associate Professor Charles E. 
Johnson, Department of Measurenient and Statistics, College of Education, 
University of Maryland. - . * - 
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tatlon of coefficients, for class means was items crossed with students nested 

*• « ' \ 



la classes (IxS: C); the design for student coefficients was it^s'^crojssed with 



students (IxS) 




Si^^cethejjva^^ components for determining generaliza- 

bllity coefficients for class means requires equal sampl^e sizes in classes, it 
was necessary to draw equalH3ii;ed .random samples of students from classes 
that .had more students than some acceptable minimum* Classes not meeting the 
minimuiu number for an analysis were dropped. ' - ^ 

Table II-4 gives several coefficients for total spores or sub-sfiores 
for the six pre-post instruments, for the total group, and for MACC^ and non- 
MACO& groups of classes separately. T^^Hlirst shows the pre*pusft correlations 
of class means, based on total number of classes. Colvmin 2 gives generaliza- 
bility coefficients for class means. ^ Column 3 gives generalizability coefficients < 
for students, ignoring the nesting of students in classes.-^? Columns4 and 5 show the 
number of classes and students involved in the determination of the generalizability 

coefficients* - * >^ * • \ 

V . .Table n-4 reveals a number of points* First, the computed generalizability 
coefficients for class me^ns for the CAPS sub-tests and j:he two mat Would You Think 



32, Let C = classes, I = items, S = students. The g^ieralizability coefficient, 
based on the various variance components, 'has the follpwing form: 

' C/(e^CI+(S, gC) + (IS, CIS,e )) • 
with components CI, (S/SC), and (IS, CIS and e,confounded). 



33 . This coefficient, again being a ratio of variance components, has the form: , 

\7r ' ' .S/{S+SI) ^ V .r? 

• , with srdivided by the appropriate h (in this case, the number of items).^/ 

" - . • ■ ■ 
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Table n-4 ■ 

Reliability Statistics of Main Pre-Post Instruments for Class Means' 
and Students, by Total Samples, MACOS (M), and NonTMACOS (N) 

- . Pre-Post 2 . '3 .4 5. 

Correlations Generalizability Generalizability 

for Class Means Coefficients: ClJ/coefficentstS^^ No. ofCls. No. of Students 



a. Questions 1-4 (AP 1-4) 

D« V^UcSllOnS O— 0 \IMr O— o; ^ 


.64 .63 .73 

- <4Q f^d 


.46 .54 .37 


• 66 • 68 . 65 

65 64 66 


1 ' »i 1 

( 

93 45 48 
93 45 48 

«/0 TZv TtU 


837 405 432 
837 405 432 


2. STEP Social Studies , Series n, 4A 
a. Sub-test 1: Organize Information 
D« oUD— test interpret inioinidtiou 
c. Sub-test 3: Assess Adequacy of Data 
, d. Sub-test 4: Dr^w Inferences 
' e. Sub-test 5* Reach Conclusions 


i. ■ 

*.86 .84 .88 

SS QCl QT 

.81 .82' .82 
.86 .87 .84 
.72 .67 .79 


f 

.7.0 .67 .73 

OA OA OA 
• oU « oU • oU 

.62 .5,0 .70 
.77 .75 .79 
.45 .34 ,.55 


.6i' .61 .ai 

QA QO ' 
« Ot . OO . OO 

.59 . 56 . 61 
.67 .69 .«5 

,27. .25 .29 


96 48 48 
<)6 4A 48 

TXO *XO 

96 48.' 48 
96 48 48 
96 48 48 


1440 720 720 
1440. 720 720 
144(3 720 720 
1440 720 720 
1440 720 720 


3. Interpretation of Data Test (IDT) 


.74 .77 .72 


.46 .48 ■ .44 


.54 .57' .50 


95 47 48 


760 376 384 


4. Social Studies Choices (SS Ch) 


.59 .55 .59 


.^1 .66 .71 


.62 .62 .61 


98 48 50 


1470 720 750 


5. What Would You Think 

a. Part A (WWA) 
. b.' Part B (yj^IB) 


.42 .32 .49 
.^0 .31 .44 


.16 .27 .03 
.18 .10^.28 


.26 .25 .27 
.11 . 07 ' .15 


93- 46 47 
'95 47 48 


1488 736 752 

1425 >05 720 / 


6. CAPS 

a. CAPS- 1 (Ability) 

b. GAPS-2 (Interest) 

c. CAPS-3 (Tolerance) ' .. 
' d. CAPS-4 (Cre'ativity) 


.57 .69 .43 
.39 .45 .35 
.. 60 .54 . 67 
. 52 .50 .55 


.00 .00 .00 
.00 ^.00 .00 
.12 .00 .29 
.29 .37 .20 


.54 .51 . . 56 
.55 .57 .53 
.61 • .63 .59 
.11 .11 .12 


84 41 43 
84 41 43 
.84 '41 43 
84 41 43 

7 


588 287 301 
5S8 287 301 
58'8 287 301 • 
588 287 301 



o 



1, CIs = Classes' 
2.i S = Students 
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sub-tests are extremely low. While some .of tbe pre-post correlations for 

* ^ 

those instruments are not high they do suggest that there may be a problem with the 
model used to determitfe the generalizability coefficients. Inspection of the 
relative sizes of the score component s*fc? those variables, indicated that the 
Student, and the student by classroonj interaction components (S and SC, . 
confounded) werfr typically the major source of variance in class means. ^The 
items by student interaction, class by Item by student interaction, and error com* 
•ponents (IS, CIS, e, confounded) were the next major contributor. 

. - . ■ T • • • ' -. ■ 

The extremely low classroom metin reliabilities did not ocfeur for 
all attitude (as opposed to achi^s^entj^instrumeats. The class mean genera- 
lizability coefficients for Social Stuflies Choices (SS Ch) were quite respectable 
' for attitude measures (see Column 2>l^Table II-4)* They wer.e higher, for 
example, than the coefficients for the Interpretation of Data Test (IDT) and fbr 
the two sub-tests of Animals and People (API -4, AP5-8). 

A second obvious point observable in Table II-4 is that generalizability 
" coefficients fQr classroom means and for individual student scores maybe 
quite different. The case of the CAPS factor-analyzed siib-testa demonstrates 

that, ■ . • 

Third, both pre-post class mean correlations and generalizability . 
coefficients for the two groups (MAC OS and non-MACOS) can differ, sometimes 
substantially,^* ^ ' 

The religbility coefficients shown in Table n-4 serve to remind one 

34« No statement about significance of differences is Implied. 

• - ^ ^ ' <» 
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of the need for prudence in interpreting "results. They also, in the opinion of 
this project, raise questions about the meaning of reliability.. The CAPS sub- 
tests, while aot burdened with a plethora of items, nevertheless should have . 
common factor structures within each sub-test. Yet computed class means, 
by the model employed (model V-B, in Cronbach, et. al.*s nomenclature), 
produced coefficients of zero. Given the pre-post correlations of class means, 
which are not trivial, one has to raise questions about the model and its ass^^np 
tions. On the other hand, if one believes the model, then questions need to 
be raised about the defensibility of thejubsequent analyses employed In this 
study of measures based on class means* No attempt will be made here to 
resotve theoretical issues of reliability according^to classical psycho- ^ 
metric theory. The basic implication of the results in Table II-4 is to im* 
pose ,an attitude o f conservatism - in analysis as well as interpretation. ^ 

- 2. Other Instnuneats ' . ^ , ! 

. . In Table n-4, generalizability coeff.cients were given for.student, 
scores for the 5 stib-tests of the STEP, Series II, Social Studies, Form 4A, 

The' published reliability for the total test for 5th grade students is . 92. 

' / 

' 35 . It may be noted, again in anticipation, that a series of analyses of 
the consequei;:)es of d is attenuation of pretest on the partial corre- 
lation of post test and treatment were marfe. Conclusions, 'as they 
are stated in this report take those analyses into account. Similarly 
analyses using Kenney's four models were piade. Again conclusions 
as stated are consistent, it is believed, with the results of those 
analyses {ct , Kenney,^ David A. A quasi-experimental approach tq 
assessing tre tm6nt effects in th^ nonequivalent control group design. 
''\ Psychological Bulletin , 83, 3, 345-462, 1975)i . . - 

3Q . STEP Series II jiandbook. Educational Testing Service, Princeton, 
New Jersey, 1971. Table 42. • 

• - , • ; . . 
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That figure was derived by the Kuder-Kichardson 20 formula'aiid is thus an 
internal consistency measure of the total test, * ^ • . 

Three scales from Anderson and Walberg, and fromWalHerg^ were 
used in midtest 2 to (i)tain measures of classroom climate, based on student 

ratings.^''^ Published reliabilities (Cronbach Alphas) for the apathy and diffi- 

... V ^ • * ' » 

"culty scales, based on 11th and 12th grade students are over . 80. The reported 

i 

reliability for the satisfaction scale, based on 8-12 year olds, is 77. 

; The project piiot-tested the apathy and satisfaction scales, *as well 
as scales for goal direction, diversity and disorganization, with 5th and. 6th 
grade clasaes, Cronbach alpha coefficients were computed for each faf 16 
classes. For the apathy scale, the range of coefficients was •GO to .71, with 
an average of.51.^® The Cronbach alpha coefficients for goal direction, di- 
versity and disorganization all averaged less than .40. These coefficients . . 

ere based on the item modifications and response formats used in the present 

\ ■ . 

study. *- • • » 

Based on initial pilot testing, the pairs of items making up scales 

in Steel'e^e Classroom Activities Questionnaire^ ^ were modified substantially 

to make the" vocabulary suitable for 5th and 6th graders. Responses of students 

37. Anderson,. Gary J. The Assessment of T.earning Environments: A 
Manuarfor the Learning Environment inventory and the' My Class 
Invgntorj^v V\tlantic Institute of Education, Halifax, Nova Scotia, 
Canada^ 1^71. . ^ . / 

* \ • * 

38.. Reliabilities for students, regardless of classes, for the apathy 

scale were .59, gnd .65 for the satisfaction scale. 

39. Steele. Joe M. . Dimensions of the Classroom Activities Questionnaire 
University of Illinois, Urbana, Illinois^, October,' 1969. . 

' - • - \ ■ I • ' 

■ . / \ ■ - • - 

. • \ ■ . - 
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in 16 classes to pajrs of items were analyzed for consistency and agreement 

■ ; / ^; ^ ^ / . 

on a class l>^^c lass basts, using Steele^s criteria. Measures of both dimensions 

• .-•'7 f^* . : 

varied with item .pairs and" .with classes^ Generally, agreement (50% o^ 



more of the students in a class agreed that an activity was a characteristic 

of the'^lass) was lower than consistency (2/3 ok* more of the students in a^lass gave 

/« . . ' ' 

the same.respoase'to both items in a pair). In this, study scale scores were 

b^sed on the sum of ratings of both items in a pair which is a departure 'from 

Steele's method of scoring. The reason* was that consistency was considered^^ 

more important than agreement, as Steele used the latter t,erm. 

' , Witt respect to teacher scales, Kerlinger and Pedhazur reported 

reliability coefficients (Cron1?ach alphas). for aliumber of samples of teachers \ 

that range from . 69 to^ . 82 for^the Education Scale Vn progress ivism and * 

(ES Vll) traditionalism scales.^^ Pedhazur^ reported a coefficient of stability 

v^ith a two-week interval for the Teachers at Work (TA^^O scale of . 82 for 

teachers.41' The Ahtipoh project did not undertake to re-evaluate ES VII or 

TAW reliabilities. 



40. Kerlinger, Fred N. , and Pedhazur, Elazar J. Attitudes and Perception 
of Bearable Traits and Behaviors of Teachers. Final Report . Projects 
No. 5-0330, Contract I?o. OE-5-10-024. New York University, ' 
New York, N.Y., Sep^30; 1967. Seeesp., Table "VII-C. 



41. Pedhazur, Elazar J. , Pseudoprogress ivism and asaessnfient of teacher behavior. 
Educational and Psychological Measurement, 1969 , 29 (2)-, 377-386. 
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